Unknown Company

Mission Data Engineer (TS/SCI with Polygraph required)

chantilly, va • Posted 4 days ago
Onsite Full Time General

Data Engineering Team ExpansionWe're looking to expand our Data Engineering team in Northern Virginia to modernize our customer's data environment to optimize user access to mission-essential and impactful data. Here's what we're looking for - does it sound like you?A senior engineer interested in enabling the widespread use of open source intelligence data for end users and data scientists across the intelligence community.You'd join the effort to expand our Data Lake offering built on top of AWS S3, DynamoDB, and Kubernetes into a community-wide data hub.The goal is modernization of the unclassified OSINT data layer with new access patterns and services that enable AI/ML enrichments, ETL pipelines, and data discovery and dissemination.Front-line building out the next-generation scalable data architecture using your knowledge of the AWS ecosystem.These are important skills to have, but not necessarily mandatory:Experience operating Data Lakes or Data Platforms (eg: Databricks) with knowledge on how to optimize storage technology for client access patterns, and how to propagate CRUD operations throughout a distributed stack (including versioning nuances).Hands on experience with the AWS S3, DynamoDB, EKS, DocumentDB, Lambda, Timestream, CloudWatch, EC2, ECS.Experience building monitoring and alerting mechanisms for data pipelines. (e.g., Prometheus, Grafana, Splunk).Experience with Infrastructure as Code tools (e.g., Terraform, CloudFormation, AWS CDK, Ansible).

Back to Job Search