General Description
- 8+ years of experience in Data Engineering or L3 level support in data Analytics
- Experience with Data Lake, data warehouse ETL pipeline development and design
- Hands-on experience with GCP data and analytics services such as Cloud DataProc, Cloud Dataflow, Cloud Dataprep, Apache Beam/Composer, Cloud BigQuery
- Data Pipeline Development: Design, develop, and maintain ETL/ELT pipelines for seamless data flow using DBT or GCP BigQuery
- Data Modelling: Implement and manage data models in BigQuery to support analytics and reporting
- Version Control: Use GIT for managing changes in data pipelines, schemas, and code
- Strong coding skills in SQL, Python, or Java
Technical Requirements
- Create and support data models and implement ETL processes based on business needs
- Monitor data quality to ensure accuracy and availability for stakeholders
- Maintain company data lake (UDP) and regional platforms data streaming from Apache Kafka
- Develop scalable data pipelines and API integrations for increasing data volumes
- Collaborate with analytics and business teams to enhance data models for BI tools
- Write unit/integration tests, document work, and contribute to engineering wiki
- Troubleshoot data issues through analysis
- Work with frontend/backend engineers, product managers, and analysts
- Design data integrations and data quality frameworks
- Evaluate open source and vendor tools for data lineage
- Develop long-term data platform strategies in collaboration with business units
- Plan and maintain data architectures aligned with business needs
- Support digital projects by understanding solutions and data structures
- Create reports, dashboards, and datasets for business users
- Maintain existing reports and dashboards
Soft Skills
- Excellent communication and presentation skills
- Problem-solving and critical thinking abilities
- Project management and organizational skills
- Team collaboration and leadership
- Market awareness and client focus
Certifications (Optional)
- Google Professional Data Engineer
- Google Professional Data Architect
Educational Qualifications
Bachelor's Degree in Computer Science, Computer Engineering, or related field
#J-18808-Ljbffr