Data Ingest Engineer

In addition to meeting the labor category requirements for which the candidate is submitted, candidates are also required to meet the following:

Required Skills:
• Experience collaborating on and devising strategies to extract meaning and value from structured and unstructured data
• Experience with the development of new requirements to support the characterization and ingestion of new data flows
• Experience with high-level analysis of IC systems, data models, data formats/types, data volumes, and data samples
• Experience with dataflow, routing and data enrichments tools (e.g. NiagaraFiles)
• Experience with scripting languates such as shell scripts, Python, Java, etc., that provide methods for data transformation, mapping, standardization, and data characterization
• Excellent oral and written communications. Comfortable in programmatic and technical exchange with internal SE and software teams, multiple levels of leadership, and across IC and DoD stakeholder agencies
• Skilled with development and implementation of SE processes and workflows
• Working functional knowledge and experience with IC-GovCloud (GM and Content Warehouse)
Job Description:
• Develop new tools using scripting languages that provide methods for data transformation, mapping, standardization, and data characterization
• Devise strategies to extract meaning and value from structured and unstructured data       
• Review data namespaces and models to recommend new data structures in support of analytic usage  
• Support data wrapping and encoding in line with service APIs (TDF, TCLD, other)
• Review data schemas and perform troubleshooting in line with data structures 
• Use tools, such as DataXplorer, to identify key data and subsequently structure data for improved discovery and search capabilities
• Define requirements for enhanced data characterization to improve discovery and search capabilities
• Work with IC partners to characterize data and document data mission value
• Develop characterization and processing documentation for individual datasets
• Provide engineering support to data stewards to ingest data 
• Analyze and develop requirements to support the ingest of new and existing data types
• Conduct technical exchange meetings with customer personnel involving data discovery, review and dataflow, and entitlements
• Develop and implement ingest processing and approval workflows
• Analyze and assess legal requirements, policies, and handling restrictions for various data types
• Determine applicable handling attributes and encode data for ingestion into analytic repository
  • TS//SCI FSP

Want to apply later?

Type your email address below to receive a reminder

Apply to Job

ErrorRequired field
ErrorRequired field
ErrorRequired field
Error
Error
insert_drive_file
insert_drive_file