Base pay range
$150,000.00/yr - $180,000.00/yr
About the Role
You’ll be the key specialist supporting Azure Data Factory and Databricks during a major cloud migration initiative. If you thrive in fast‑paced production environments—solving pipeline failures, optimizing Spark jobs, and keeping complex data workflows running—this role gives you real responsibility, visibility, and technical ownership.
Responsibilities
- Support and troubleshoot Azure Data Factory pipelines and Databricks jobs across production environments.
- Ensure stability, performance, and uptime of ETL/ELT workflows during cloud migration initiatives.
- Perform root‑cause analysis on pipeline failures, Spark issues, cluster timeouts, and data mismatches.
- Collaborate with engineering and DevOps teams to optimize workflows, deployments, and cloud integrations.
Qualifications
- Strong experience with Azure Data Factory, Databricks, and Azure‑based data engineering.
- Proven background in ETL/ELT processes, data integration, and orchestration.
- Solid understanding of cloud data services (ADLS Gen2, Azure SQL, Databricks, Functions, etc.).
- Hands‑on experience in monitoring, debugging, and optimizing production data pipelines.
Required Skills
- Databricks
- ETL/ELT processes
- Data integration
Preferred Skills
- Experience with Azure SQL
- Knowledge of ADLS Gen2
- Familiarity with Azure Functions
Seniority level
Mid‑Senior level
Employment type
Full‑time
Job function
Information Technology
Industries
Banking
Location
Charlotte, NC
#J-18808-Ljbffr