We are seeking a Data Pipeline Engineer to help build and manage the imagery data pipeline behind perception model development for a longstanding Department of War client. The platform and pipeline are new, and much of the design, process, and tooling is still being decided. The engineer will do hands-on pipeline work, provide technical oversight of the integrator and vendors building parts of the system, and act as a technical point of contact between the government team, model developers, and end users.
The program runs much like a startup. We need someone who takes ownership of problems, not someone who completes assigned tasks and stops there. When the engineer spots an issue, such as a recurring data quality problem or a broken handoff between teams, we expect them to bring together the platform's users, the integrator, and the government team, work out a solution, and see it through with minimal oversight. The right candidate is comfortable with ambiguity and willing to put structure in place where none exists yet.
The engineer will work with a wide range of people: non-technical users, experienced model developers, vendors, government staff, other SETA contractors, and representatives of multiple military services. They need to hold their own in technical discussions with vendors and communicate clearly enough to engage senior leaders when needed.
Prior management experience is not required. This position is meant for a strong engineer who wants to grow into technical leadership. As the platform matures and the engineer earns the client's trust, the role will shift toward overseeing vendor work, planning pipeline development, and coordinating across programs and with senior stakeholders.
Position Responsibilities
- Build, operate, and improve the pipelines that ingest, curate, label, and deliver EO/IR imagery and metadata to perception model developers, primarily on Databricks with supporting custom software.
- Monitor data quality across the pipeline, and trace and fix problems with ingest, formats, labeling, metadata, and lineage.
- Provide technical oversight of integrator and vendor work: review designs, code, and deliverables; push back on weak technical approaches; and give the government team an independent assessment of quality and risk.
- Find problems and gaps in the pipeline or platform without waiting for them to be assigned, and lead the effort with the government team, integrator, users, and model developers to resolve them.
- Turn operational needs from non-technical subject matter experts into data requirements and pipeline changes, and guide junior integrator engineers in implementing them.
- Coordinate with stakeholders across multiple military services, vendors, other SETA contractors, and the model development community.
- Document pipeline architecture, data standards, processes, and runbooks while the platform's conventions are still being set.
- Write clear technical summaries, status updates, and issue papers for government leads, and over time contribute to material for senior leaders.
- Recommend improvements to tools, processes, and technical approaches as the platform matures and adds new sensor modalities.
Required Qualifications
- Active Secret clearance.
- Bachelor's degree in computer science, data science, software engineering, information systems, engineering, or a related technical field.
- Five or more years of hands-on experience in data engineering, MLOps, software engineering, or a closely related technical role.
- Working proficiency with a standard data engineering stack: Python, SQL, distributed processing such as Spark, data modeling, data versioning, and pipeline orchestration.
- Experience building or operating data pipelines that support ML model development, including data curation, preparation, and labeling workflows.
- The technical depth to evaluate vendor architectures, code, and deliverables independently and to hold one's own with experienced engineers.
- A demonstrated record of taking ownership: identifying problems outside one's assigned scope and driving them to resolution.
- Ability to explain technical issues clearly, in writing and in person, to audiences ranging from non-technical users to senior engineers.
- Comfort working on a new platform where requirements are incomplete and priorities shift.
- Ability to work on-site in Arlington, Virginia, with travel up to 5 percent.
Preferred Qualifications
- Experience with Databricks, such as Unity Catalog, Delta Lake, Workflows, or MLflow.
- Experience working with EO/IR imagery, full-motion video, or other sensor data. Familiarity with additional modalities such as SAR or LiDAR is a plus.
- Experience with computer vision or perception model development (detection, classification, tracking), and an understanding of what model developers need from training and evaluation data.
- Experience with data labeling and annotation tools and workflows.
- Experience with cloud platforms, particularly AWS GovCloud.
- Experience supporting Department of War, federal, or other complex multi-stakeholder environments.
- Familiarity with Agile/Scrum delivery, backlog management, and writing requirements or user stories in tools such as Jira or Confluence.
- Experience overseeing contractor or vendor technical work, or leading a small technical team or effort.
- Experience at a startup or on a team standing up a new platform or capability.
Benefits:
- Competitive Salary
- Flexible work schedule
- Time Off: PTO, VTO, Holidays
- Full Competitive Benefits Package
- Medical/Dental/Vision Coverage
- Pre-tax FSA and HSA
- Life and Disability Insurance
- Educational Assistance
- 401K Plan with 4% Non-elective Employer Contribution
- Performance-based profit sharing
- Opportunities to volunteer and give to charities
- Employee and growth-centered culture of teamwork and shared goals
Data Pipeline Engineer in arlington at Unknown Company
This position is listed as contract and onsite.