Required Skill/ JD
Azure Databricks and Pyspark
Skills: Data ETL / Data Engineering
Key Technology: ADF, Databricks, dbt, Azure Cloud Services
Supporting Technology: MS SQL Server ADW/DB, Python, Pyspark, Devops
Proven development experience in building complex data pipelines for lakehouse/data warehouses using Agile methodology.
Experience: 9-10 years
Skill proficiency rating and required years of experience mentioned in skill matrix table.
| Required Skills | Rating (Scale 1-10) | Work Experience (Years) | Last Used (Year) | Related Projects / End Customer Names |
| ADF | 9-10 | 9-10 years | ||
| Pyspark | 8 | 9-10 years | ||
| Azure Databricks | 9 | 9-10 years | ||
| DBT | 8 | 9-10 years | ||
| Azure Cloud Services | 9-10 | 9-10 years |