Sr Azure DevOps Engineer – AI & Data FocusedWe're seeking a Sr Azure DevOps Engineer, who will sit on the AI team, and focus on deploying data pipelines to strengthen our cloud platform engineering team. Given most of the team you'd be working with is not strong with Databricks, we're looking for someone who has experience deploying data pipelines with Databricks as the primary focus (65%). Specifically design, deploy, and optimize Azure Databricks workspaces, clusters, and jobs (including use of Databricks Asset Bundles).
The other 35% will be focused on traditional software Azure DevOps, using ARM templates currently for IaC, but we're considering using other IaC tools like Terraform. You must be strong building CI/CD pipelines using Azure DevOps and GitHub. And we're also looking for someone to be hands on scripting with Python, PowerShell, Bash.What You'll Be DoingDesign, deploy, and optimize Azure Databricks workspaces, clusters, and jobs using IaC and Databricks Asset Bundles.Architect and automate Azure environments with Infrastructure-as-Code (Bicep, ARM, Terraform).Own Git strategy and CI/CD pipelines (Azure DevOps, GitHub): branching standards, PR automation, and release orchestration.Partner with data-engineering and platform teams to run fully isolated dev, staging, and production environments.Develop reusable, modular IaC templates for consistent, reliable deployments across all tiers.Embed automated testing and monitoring in every pipeline to ensure resilient, high-performance systems.Continuously identify opportunities to streamline deployments and boost reliability through automation.Champion DevOps culture: automated testing, shift-left security, trunk-based development, post-mortems.Audit and improve tooling, processes, and infrastructure management practices on an ongoing basis.Skills We're Seeking8+ years of experience with DevOps3+ years of experience with Azure DevOpsStrong experience with Databricks is a hard requirementMust have IaC experience, any tool is fine, but ARM templates are preferredMust be proficient scripting with Python, PowerShell and/or BashNice To Haves (In No Particular Order)Multi-cloud experience with AWS and/or GCP – even though Azure is the strong focus near term, we may be going multi-cloudExperience with Data Engineering,.NET Development or Python DevelopmentExperience deploying ML modelsExperience with Site Reliability and Cloud MonitoringExperience migrating to—or building—data platforms from the ground upExperience with Azure SecurityExperience working in an Agile delivery model