Cloud Data Engineer
Location: Remote long term contract
Key Responsibilities:
- Design, develop, and implement data platform solutions using Azure Data Factory (ADF), Self-hosted Integration Runtime (SHIR), Logic Apps, Azure Data Lake Storage Gen2 (ADLS Gen2), Blob Storage, and Snowflake.
- Review and analyse existing on-premises ETL processes developed in SSIS and T-SQL.
- Perform data validation testing/QA to ensure data consistency between on-premises SQLServer and cloud-based Azure and Snowflake environments.
- Implement DevOps practices and CI/CD pipelines using GitActions.
- Collaborate with cross-functional teams to ensure seamless integration and data flow.
- Optimize and troubleshoot data pipelines and workflows.
- Ensure data security and compliance with industry standards.
Preferred Qualifications:
- Experience with data modelling and database design.
- Knowledge of data governance and data quality best practices.
- Experience with development in Databricks for data engineering and analytics workloads.
- Familiarity with other cloud platforms (e.g., AWS, Google Cloud).
- Certification in Azure or Snowflake.
Azure Data Engineer in Remote at Unknown Company
This position is listed as contract and able to be worked remotely.