Data Platform Engineer - AI

We are looking for a hands-on Technical Lead – Data Platform & Services Engineering with strong expertise in Azure Data Engineering, backend services, APIs, analytics, and cloud architecture. The candidate will design, build, modernize, and operate enterprise-scale data platforms and services on Microsoft Azure.

Key Responsibilities:

Data Platform & Engineering:

• Design and build scalable Azure data platforms, ETL/ELT pipelines, and analytical solutions.
• Develop large-scale data processing using Azure Databricks, Spark/PySpark, Azure Synapse, and Azure Data Factory.
• Design Lakehouse/Medallion architectures using ADLS Gen2, Delta Lake, and Bronze/Silver/Gold layers

Backend Services & Integration:

• Design and develop REST APIs and backend services using C#, .NET, and ASP.NET Core.
• Build data and integration services using Azure SQL, Cosmos DB, Kusto, Azure Functions, Event Hubs, and Service Bus.
• Implement microservices and event-driven processing patterns with secure authentication and authorization.

Modernization & Reliability

• Modernize legacy data pipelines, services, APIs, storage platforms, and application components.
• Support platform and data migrations while ensuring functional and data parity.
• Implement logging, telemetry, dashboards, and proactive alerting using Azure Monitor and Application Insights

Cloud, DevOps & Technical Leadership

• Build and maintain CI/CD pipelines using Azure DevOps and Git.
• Implement secure cloud practices using Azure Key Vault, identity, authentication, and access controls.
• Support Docker and Kubernetes/AKS-based workloads where applicable.

Mandatory Skills:

Data Engineering

• Azure Databricks, Spark/PySpark
• Azure Synapse Analytics, Azure Data Factory
• ADLS Gen2, Delta Lake
• SQL Server / Azure SQL
• Cosmos DB, Kusto / Azure Data Explorer
• ETL/ELT, Data Warehousing & Data Modeling
• Lakehouse / Medallion Architecture
• Data Quality, Reconciliation & Governance

Backend & Services

• C#, .NET / ASP.NET Core
• REST APIs & Microservices
• Azure Functions
• Event Hubs & Service Bus
• Entity Framework Core
• Authentication & Authorization

Cloud & DevOps

• Microsoft Azure
• Azure DevOps, Git & CI/CD
• Azure Monitor & Application Insights
• Azure Key Vault
• Docker / Kubernetes

Good to Have

• React or Angular, TypeScript
• GraphQL
• Power BI
• Infrastructure as Code
• SRE / Production Support experience
• AI/ML or AI-enabled analytics exposure