Mid Level Data Engineer

Now is a great time to join Redhorse Corporation.

Key Responsibilities

• Ingest, configure, and transform structured, semi-structured, and unstructured datasets to meet mission partner and stakeholder requirements.
• Build, automate, and maintain scalable ETL/ELT pipelines supporting DevOps and rapid analytics delivery.
• Maintain data pipeline operations, monitor environment health, and implement automated performance optimization and cost-reduction practices.
• Work under general guidance to prototype new data capabilities, evaluate emerging technologies, and deploy end-to-end data solutions.
• Collaborate with cross-functional technical teams to troubleshoot pipeline bottlenecks, optimize database structures, and implement secure data retrieval methods.
• Implement and automate DoD Security Technical Implementation Guides (STIGs) across data systems to ensure strict compliance and system security.

Requirements

• Hands-on experience developing data workflows using Databricks (e.g., Delta Lake, Lakehouse architecture, PySpark).
• Experience integrating data pipelines with business intelligence and data visualization platforms, particularly Qlik (Qlik Sense or QlikView).
• Experience working within the DoD Advana Data Environment.
• Familiarity with deploying and engineering data pipelines across classified networks and multiple security domains.
• Experience with CI/CD tools and version control systems such as GitLab, Jira, or Jenkins.
• Active Top Secret (TS) clearance with Sensitive Compartmented Information (SCI) eligibility.