Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Snowflake.
Collaborate with cross-functional teams to gather requirements for ETL processes and ensure seamless integration with existing systems.
Develop complex SQL queries to optimize database performance and troubleshoot issues in Snowflake.
Implement automated testing frameworks to ensure high-quality delivery of ETL jobs.
Desired Candidate Profile
5-8 years of experience in Data Engineering with expertise in ADF, ETL, Snowflake, and Azure Databricks.
Strong understanding of cloud-based technologies such as AWS or GCP is an added advantage.
Proficiency in writing efficient SQL queries for querying large datasets.
Experience working on big-data processing tasks including batch/streaming data ingestion.