Lead Data EngineerLocation: Remote (EST)Contract: 6+ months ongoing (possible contract to hire/must be eligible for conversion)Summary: As a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be responsible for data integration, migration, and analysis using a variety of Microsoft technologies. This role requires a deep understanding of Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL and Python.
You will work closely with the Data Lead and Technical Analyst to translate business requirements into technical solutions and ensure the seamless flow of data across our systems.Key Responsibilities:Design, develop, and maintain data pipelines using Azure Data Factory, Logic Apps, and Azure Service BusImplement and manage Databricks for advanced data processing and analyticsDevelop complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL)Collaborate with cross-functional teams to understand business requirements and translate them into technical specificationsEnsure data quality and integrity across various data sources and systemsManage data integrations and migrations between diverse systems, ensuring minimal disruption to business operationsUtilize Azure CI/CD pipelines for continuous integration and delivery of data solutionsCreate and maintain data workflows using Power AutomateConduct data analysis to support business decision-making processesWork independently and as part of a team to deliver high-quality data solutionsCommunicate effectively with stakeholders to understand their data needs and provide technical guidance