Sr. Data EngineerWe are looking for Data Engineers to build data pipelines for the Data Center business group's Data Science team at the largest social media organization using its next generation data tools. As a member of a centralized Data Science/Data Engineering team you will contribute to a variety of projects and technologies, depending on partner needs.Responsibilities• Partner with leadership, engineers, program managers and data scientists to understand data needs.• Design, build and launch extremely efficient and reliable data pipelines to move data across several platforms including Data Warehouse, online caches and real-time systems.• Build data expertise and own data quality for your areas.QualificationsSQL coding - Expert in SQL with good understanding of how relational databases workExperience querying massive datasets using Presto, Hive etc.Good Python Programming ExperienceExperience with Data Warehousing ArchitectureExperience with workflow management engines like Airflow, Data swarm, Luigi etc.2+ years’ experience in custom ETL design, implementation and maintenanceExperience with data quality and validation.Experience with SQL performance tuning and e2e process optimization
Unknown Company