Senior Data EngineerRequired Skills & Experience:Microsoft Fabric (Lakehouse, Warehouse, Data Factory, Notebooks, OneLake)Azure Data Factory and ETL/ELT designSQL/T-SQL, Python, PySparkML pipeline concepts (feature engineering, training, batch scoring, MLflow)Azure DevOps CI/CD pipelinesBicep / Infrastructure as CodeData Lake / Lakehouse and medallion architectureNice to Have Skills & Experience:Azure Synapse Analytics and Azure DatabricksMicrosoft PurviewPower BI semantic models and Direct LakeFabric Real-Time Intelligence (Eventstream, KQL)GitHub Enterprise and fabric-cicdExperience migrating SAS workloadsJob Description:The Senior Data Engineer designs, builds, tests, and supports the data pipelines and data products behind our analytics, reporting, and machine learning work on Azure and Microsoft Fabric.
The role focuses on data engineering: ingesting, transforming, and modeling structured and unstructured data from sources such as Azure Synapse, Azure SQL, SQL Server, and ADLS Gen2. That data lands in Fabric Lakehouse and Warehouse on OneLake through Azure Data Factory, Fabric Data Factory pipelines, Dataflow Gen2, and PySpark notebooks. The engineer will also design and run machine learning (ML) pipelines with the Data Science team, automate builds and releases through Azure DevOps pipelines, and set up supporting Azure resources with Bicep templates. They will apply secure data practices (Managed Identity, Microsoft Entra ID, Key Vault, OneLake security, and Microsoft Purview) and build data quality, lineage, and governance into every pipeline. This role works closely with Data Scientists, Solution Architects, Software Engineers, DevOps Engineers, QA Engineers, Project Managers, Information Security Engineers, and Delivery Managers.
Senior Data Engineer in deerfield beach at Unknown Company
This position is listed as full time and onsite.