Unknown Company
Senior Data Engineer (PostgreSQL, Python, Azure)
Location: Reston VA (on-site 9-10 days a month) - Only local candidates will be considered. No relocation is available.
Salary: Open and will be commensurate with experience.
NOTE: This is a full time position and this person must be a Green Card Holder or be a US Citizen of the United States, as per the company, due to government compliance.
Must have the following:
- Azure Data Factory
- Databricks
- Python
- SQL
- ETL/ELT pipelines
- Data Lake
- Spark
- Data Engineering
- Cloud Data Platforms
- CI/CD
Responsibilities:
- Design, build, and maintain scalable production data pipelines supporting enterprise data platforms
- Perform exploratory data analysis, statistical analysis, and data validation to support analytics and reporting
- Develop and optimize ETL/ELT workflows including job design, orchestration, and performance tuning
- Build and maintain relational database schemas, queries, and stored procedures
- Work within Azure-based data environments including Data Factory, Databricks, and Data Lake Storage
- Collaborate with analytics, BI, and engineering teams to deliver reliable data products
- Implement monitoring, logging, and observability for data pipelines
- Maintain documentation, data lineage, and governance standards
- Participate in architecture discussions and contribute to long-term data platform strategy
Requirements:
- Bachelor's degree in Computer Science, Statistics, Mathematics, Information Science, Data Engineering, Finance, or related field (Master's preferred)
- 5 years of data engineering experience working with production data pipelines
- 5 years of applied data analysis and statistical data work
- 3 years of ETL / ELT development experience
- 3 years working with relational databases and performance tuning
- Experience with Azure data services (Data Factory, Databricks, Data Lake, Synapse, Delta Lake, or similar)
- Strong programming experience with Python, PySpark, SQL, and Bash
- Experience with Kafka, SAP data services, or similar integration tools preferred
- Experience with PostgreSQL, SAP ASE, or comparable databases
- Experience with Power BI or BusinessObjects is a plus
- Experience with CI/CD pipelines, Git, Kubernetes, and infrastructure-as-code
- Knowledge of data governance, cataloging, and access control
- Experience with monitoring tools such as Datadog, Grafana, or Prometheus
- Ability to work independently while managing multiple priorities
- Strong communication and documentation skills
- Must be eligible to work in the United States