Role Summary
Technical Lead - Data Engineering with 10+ years of experience in designing, building, and leading enterprise-scale data platforms and analytics solutions on Azure Cloud. The role requires a strong blend of technical expertise, solution architecture, stakeholder management, and team leadership.
Roles, Responsibilities & Skills
- Lead the design, architecture, and implementation of scalable Data Lakehouse, Data Warehouse, and Analytics solutions on Azure Cloud.
- Architect and develop data pipelines using Azure Databricks, PySpark/Scala, Azure Data Factory (ADF), ADLS, and Azure SQL.
- Drive performance optimisation and large-scale data processing on Azure Data Lake Storage (ADLS).
- Design and implement CI/CD pipelines, infrastructure automation, and DevOps best practices for cloud data platforms.
- Provide technical leadership for cloud migration and modernisation initiatives leveraging Azure PaaS and IaaS services.
- Work closely with customers and stakeholders to understand business requirements, define use cases, and establish solution roadmaps.
- Participate in solution design workshops, effort estimation, architecture reviews, and status governance meetings.
- Ensure adherence to data governance, data quality, security, compliance, and best-practice standards.
- Collaborate with Data Analysts, Business Analysts, SMEs, and Governance teams for data profiling, cleansing, source system analysis, and issue resolution.
- Drive continuous improvement initiatives and proactively identify opportunities for optimisation and innovation.
- Mentor and coach team members through technical guidance, code reviews, and competency-building initiatives.
- Build high-performing teams and contribute to capability development within the organisation.
- Strong communication, stakeholder management, problem-solving, and leadership skills with experience leading cross-functional teams.