Azure Data Engineer

Job Title:

Azure Data Engineer

Location:

Atlanta, GA (onsite)

Job Summary

We are seeking an experienced Azure Data Engineer with strong hands-on expertise in Azure Synapse Analytics, Apache Spark, PySpark, Spark SQL, and Data Lake architecture . The ideal candidate will be responsible for designing, developing, optimizing, and supporting scalable data processing and analytics solutions in Azure environments.

The candidate should have a good understanding or exposure to Microsoft Fabric and be comfortable working across development and production support environments.

Key Responsibilities

• Design, develop, and maintain scalable data engineering pipelines and solutions using Azure services.
• Work extensively with Azure Synapse Analytics for data processing, analytics, and data warehousing.
• Develop data transformation and processing solutions using PySpark and Spark SQL .
• Apply strong knowledge of Apache Spark architecture , distributed computing, and large-scale data processing.
• Design and implement Data Lake architectures , including the Medallion Architecture (Bronze, Silver, and Gold layers) .
• Work with Microsoft Fabric and support the adoption or integration of Fabric-based data solutions.

Key Skills & Experience:

• Strong hands-on experience with Azure Synapse Analytics , along with a good understanding or exposure to Microsoft Fabric
• Deep understanding of Apache Spark architecture and distributed data processing concepts
• Strong knowledge of Data Lake architecture , including Medallion Architecture
• Hands-on experience in PySpark and Spark SQL for data transformation and processing
• Solid communication skills with the ability to work effectively with cross-functional teams
• Strong problem-solving and troubleshooting skills in data engineering environments
• Should have worked in diverse environment with IT/Business/ Onsite offshore Model and also need to easily adapt on Development and Support models.