Overview
Senior Data Platform Engineer — Onsite Phoenix, AZ
Responsibilities
* Design and maintain Airflow DAGs for production data workflows
* Develop and optimize Spark / PySpark jobs on Dataproc
* Build and optimize complex SQL transformations
* Develop REST APIs using FastAPI Python to support data services
* Implement robust data quality and validation frameworks
* Monitor pipeline performance, retries, and SLA compliance
Qualifications
* 6+ years of data engineering experience
* Strong Python programming skills
* Production experience with Apache Spark PySpark
* Experience with Airflow DAG development
* Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
* Experience building APIs using FastAPI
* Strong SQL and data modeling knowledge
* Experience implementing data quality checks (schema validation, row count checks, anomaly detection)
#J-18808-Ljbffr
Senior Data Platform Engineer — Onsite Phoenix, AZ
Responsibilities
* Design and maintain Airflow DAGs for production data workflows
* Develop and optimize Spark / PySpark jobs on Dataproc
* Build and optimize complex SQL transformations
* Develop REST APIs using FastAPI Python to support data services
* Implement robust data quality and validation frameworks
* Monitor pipeline performance, retries, and SLA compliance
Qualifications
* 6+ years of data engineering experience
* Strong Python programming skills
* Production experience with Apache Spark PySpark
* Experience with Airflow DAG development
* Hands-on experience with GCP (Dataproc, BigQuery, Cloud Storage preferred)
* Experience building APIs using FastAPI
* Strong SQL and data modeling knowledge
* Experience implementing data quality checks (schema validation, row count checks, anomaly detection)
#J-18808-Ljbffr
Senior Data Platform Engineer in phoenix at Unknown Company
This position is listed as full time and onsite.