Overview We are looking for a Senior Data Engineer with strong 7-10 year hands-on experience in Azure and Microsoft Fabric to help modernize and migrate data products from Azure Synapse to Microsoft Fabric. The ideal candidate will have experience with Azure Data Factory, notebooks, Spark/PySpark, and building scalable data pipelines that support analytics and business reporting needs.ResponsibilitiesMigrate existing data products, code, and workloads from Azure Synapse to Microsoft FabricDesign, build, and support scalable data pipelines and data processing workflowsDevelop and enhance data products that support business and analytics use casesBuild solutions using Azure Data Factory, notebooks, Spark/PySpark, SQL, and PythonRefactor pandas-based transformation logic into scalable PySpark and Python implementationsWork with structured and semi-structured data to enable downstream consumptionImplement full, delta, and CDC-based ingestion patterns from multiple data sourcesApply data warehousing concepts and medallion architecture principles in solution designValidate migrated code and data outputs to ensure accuracy, consistency, and completenessPerform data quality checks, performance tuning, monitoring, and issue resolutionTroubleshoot pipeline, code, and environment issues across Azure-based platformsCollaborate with data analysts, engineers, and business stakeholders to gather requirements and deliver solutionsDocument technical designs, migration approaches, and data product logicSupport code reviews, testing, release, and deployment activitiesRequired Technical Skills7-10 years of strong hands-on experience with Microsoft Fabric and Azure fundamentalsStrong hands-on experience with Azure Synapse and Azure Data FactoryStrong hands-on experience with Spark and PySparkProficiency in Python and SQLExperience with pandas and refactoring to PySpark/Spark-based implementationsStrong experience with Git and Azure DevOps, including pull requests, CI/CD, and deployment automationExperience building reusable engineering patterns and shared librariesSolid understanding of Azure storage, compute, security, and identityStrong knowledge of data modeling, data transformation, and warehousing conceptsExperience with performance optimization and tuningTechnologies, Platforms, and ToolsMicrosoft FabricMicrosoft Azure FundamentalsAzure Data FactoryPreferred knowledge on source systems such as SAP ECC, S/4 HANA, Oracle ERP, SalesforceWorked with Delta, Parquet, JSON, and CSV file formatsAzure DevOps, TerraformSummaryLocation: Irving, Texas USType: Full time
Data Engineer MS Fabric in irving at Unknown Company
This position is listed as full time and onsite.