Data EngineerWe are seeking a skilled Data Engineer. The ideal candidate will have strong expertise in SQL, Azure data services, Databricks, and modern data engineering practices. You will be responsible for designing, building, and maintaining scalable data pipelines that support analytics, reporting, and operational initiatives.
Experience with workflow orchestration tools such as Airflow or Astronomer is highly desirable.Key ResponsibilitiesDesign, develop, and maintain scalable and reliable data pipelines for batch and real-time data processing.Build and optimize ETL/ELT workflows to ingest, transform, and load data from multiple source systems.Develop and optimize complex SQL queries, stored procedures, and database objects for high-performance data processing.Work with Azure data services, including Azure Data Factory, Azure Data Lake Storage, Azure SQL Database, and related cloud technologies.Develop data transformation workflows using Databricks and Apache Spark.Orchestrate and monitor data pipelines using Apache Airflow or Astronomer.Process and manage large-scale structured and unstructured datasets efficiently.Collaborate with data architects, analysts, and business stakeholders to understand data requirements.Ensure data quality, integrity, security, and governance across data platforms.Troubleshoot pipeline failures and optimize performance for scalable data processing.Participate in code reviews and follow best practices for CI/CD and version control.Required SkillsStrong proficiency in SQL with excellent database design and query optimization skills.Hands-on experience with Azure Data Services, including: Azure Data Factory (ADF)Azure Data Lake Storage (ADLS)Azure SQL DatabaseAzure Synapse Analytics (preferred)Working experience with Azure Databricks and Apache Spark.Experience building and maintaining ETL/ELT data pipelines.Knowledge of Apache Airflow or Astronomer for workflow orchestration.Experience working with both structured and unstructured datasets.Understanding of data warehousing concepts and dimensional data modeling.Familiarity with Git and CI/CD deployment practices.Strong analytical and problem-solving skills.Preferred SkillsExperience with Delta Lake and Lakehouse architecture.Knowledge of Python or PySpark for data engineering tasks.Familiarity with Azure DevOps.Experience with data governance and metadata management.Exposure to streaming technologies such as Kafka or Event Hubs is a plus.Experience working in Agile/Scrum environments.QualificationsBachelor's degree in Computer Science, Information Technology, Engineering, or a related field.5+ years of experience in Data Engineering or related roles.Experience building cloud-native data solutions on Client Azure.Strong communication and collaboration skills.Nice to HaveAzure Data Engineer Associate certification.Experience with enterprise-scale analytics platforms.Exposure to monitoring and observability tools for data pipelines.This role is ideal for a Data Engineer with expertise in Azure, Databricks, SQL, and modern ETL/ELT pipeline development who enjoys building scalable, cloud-based data solutions. Company Benefits & Culture include an inclusive and diverse work environment, opportunities for professional growth and development, and comprehensive health and wellness benefits.