Lead Azure Data Engineer
Location: Remote
Job Type: Full Time
Job Description:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
- 10+ years of experience in data engineering / data architecture, with deep hands-on expertise in Microsoft Azure
- Expert-level experience with Azure Databricks and Apache Spark (PySpark, Spark SQL)
- Delta Lake
- Unity Catalog
- Job orchestration and performance tuning
- Strong experience with Snowflake on Azure, including:
- Schema and data model design
- Performance and cost optimization
- RBAC, Streams, and Tasks
- DBT (Core or Cloud) expertise:
- Project structure and best practices
- Tests, exposures, macros
- Strong fundamentals in SQL and Python
- Proven experience building ETL/ELT pipelines using:
- Azure Data Factory (ADF)
- Azure Synapse / Microsoft Fabric pipelines
- Familiarity with streaming platforms such as Event Hubs and/or Kafka
- Solid understanding of
- Lakehouse and data warehousing architectures
- Dimensional modeling
- Medallion architecture patterns
- Data quality frameworks
- Strong knowledge of security and governance, including:
- Microsoft Purview (catalog, lineage)
- Data masking and PII handling
- Managed identities
- Private networking
- Excellent communication and documentation skills, with the ability to:
- Create architecture and design documents
- Present to both technical and business stakeholders
- Consulting / agency experience, with the ability to lead multiple concurrent projects
- Willingness to travel as required
Nice to Have
- Experience with Azure ML, feature stores, or serving ML pipelines from Databricks or Snowflake
- Infrastructure as Code (IaC) using Terraform or Bicep
- Containerization experience with Docker
- Observability and data quality tooling, such as:
- Great Expectations / Delta Expectations
- Databricks Quality Flows
- Monte Carlo
- Datadog
Preferred Certifications
- Databricks Certified Data Engineer Professional or Databricks Architect
- Microsoft Azure:
- DP-203 – Azure Data Engineer
- Azure Solutions Architect Expert
- Azure Security Engineer Associate
- Snowflake:
- SnowPro Core
- SnowPro Advanced
Lead Azure Data Engineer in Remote at Unknown Company
This position is listed as full time and able to be worked remotely.