Data Engineer

Data EngineerThe Data Engineer builds, maintains, and supports reliable, secure data pipelines and analytical data stores that power enterprise analytics, reporting, and AI use cases. With 3-6 years of hands-on data engineering experience, this role works within established architecture standards, partnering with other team members to deliver and operate solutions across the Azure ecosystem.You will contribute to implementations on Microsoft Fabric, Azure Databricks, and modern lakehouse architectures, and help support the migration of Databricks workloads to Microsoft Fabric, while working with business intelligence, analytics, AI, and business stakeholders. This role emphasizes data quality, reliability, and continuous learning.Essential Duties and ResponsibilitiesDevelop, test, and maintain batch and streaming data pipelines using Databricks, Fabric Data Pipelines, and Azure-native services.Implement ETL/ELT processes that ensure data quality, accuracy, and consistency across systems.Build and maintain lakehouse and medallion (Bronze/Silver/Gold) data layers following team standards.Support Databricks-to-Fabric migration work when and where applicable, including converting notebooks and pipelines, and validating results.Monitor pipelines, troubleshoot failures, and help tune for performance, scalability, and cost efficiency.Integrate and model data from FIS core banking and H360 systems into the lakehouse for analytics and reporting.Support pipelines for payments data (e.g., ACH, wire, card, and real-time payments), including ingestion, reconciliation, and reporting.Design, build, and maintain enterprise-grade data platforms using Microsoft Fabric, Azure Data Lake, Azure Synapse, and Azure Databricks.Architect and implement lakehouse and medallion architectures (Bronze/Silver/Gold) to support analytics and BI workloads.Define standards for data ingestion, transformation, storage, and access across structured and semi-structured data sources.Microsoft expertise across the data and analytics stack (Fabric, Azure Data Lake, Synapse, Power BI, Microsoft Purview).Plan and execute Databricks-to-Fabric migrations, including workload assessment, Delta/OneLake data movement, notebook and pipeline conversion, semantic model re-pointing, validation, and cutover where applicable.Data Modeling & Analytics EnablementDesign and maintain logical and physical data models optimized for analytics, reporting, and downstream consumption.Build semantic models and curated datasets to support Power BI and enterprise Business Intelligence use cases.Partner with BI developers, analysts, and business stakeholders to translate reporting requirements into scalable data solutions.DevOps, CI/CD & ReliabilityImplement and manage CI/CD pipelines using Azure DevOps, Git for data engineering source control and automated deployments of data engineering workloads.Enforce best practices for source control, automated testing, deployment, and environment management.Ensure high availability, fault tolerance, and operational excellence for production data systems.Governance, Security & ComplianceImplement data governance, security, and access controls, including role-based access and data classification.Ensure compliance with enterprise data policies and regulatory requirements.Collaborate with security and infrastructure teams to enforce secure data handling and platform standards.Data Quality SupportValidate daily, weekly, and monthly data loads.Investigate data mismatches.Reconcile source-to-target records.Validate business-critical reporting datasets.Verify completeness, accuracy, and timeliness of dataCollaboration & GrowthParticipate in code reviews, design discussions, and team knowledge sharing.Communicate clearly with business, analytics, and AI teams to enable data-driven decision making.Minimum Qualifications3-6 years of professional experience in data engineering, data platform development, or analytics engineering.Bachelor's degree in Computer Science, Engineering, Information Systems, or related field (or equivalent experience).Advanced working knowledge of SQL and hands-on experience with Python or Spark-based development.Hands-on experience with data pipelines and ETL/ELT concepts, including data quality checks.Working experience with: Microsoft Fabric (Lakehouse, Data Pipelines, OneLake, Semantic Models) or Azure Databricks (Spark, Delta Lake)Data modeling for analytics and BIGit and Azure DevOps (CI/CD, automated deployments)Business Intelligence platforms, especially Power BIStrong problem-solving skills and willingness to learn.Preferred QualificationsFIS core banking and H360 experience, including extracting, modeling, and reconciling data from FIS core systems and H360 for analytics, reporting, and payments use cases.Payments experience in financial services, such as ACH, wire, card, or real-time payments data, Payment processors like TSYS, REPAY, FISERV etc; payment reconciliation and reporting; ISO 20022 and NACHA data formats.Databricks expertise (Unity Catalog, Delta Live Tables / Lakeflow, Databricks Workflows).Databricks-to-Fabric migration experience or exposure, including notebook and pipeline conversion and Power BI semantic model cutover.Experience in financial services, regulated industries, or enterprise environments.Exposure to streaming data and real-time analytics.Familiarity with data governance frameworks, metadata management, and data quality tooling.Microsoft or Databricks certifications preferred not required: Azure Data Engineer Associate (DP-203)Microsoft Fabric Analytics EngineerDatabricks Data Engineer AssociateBenefits & PerksCompetitive employer contribution to medical, dental and vision coverage401k plan with employer matchFlexible Spending Accounts (FSA) and Dependent Care AccountsEmployee Assistance Program (EAP)Employer provided Calm subscriptionEmployer provided mental health benefits through TeladocLife, AD&D and disability insuranceMinimum 15 Days of Vacation, 11 Paid Federal Holidays, Paid Time off to VolunteerOnline discount programTuition Reimbursement Program