Unknown Company

[IT] LEAD SOFTWARE ENG | DATA

new york, ny • Posted 6 days ago
Onsite Full Time General

Lead Software Engineer | DataThe Data Engineering team is developing the backbone of *** solutions. To do this, the team is using cutting-edge technologies and frameworks such as BigQuery, Spanner, Bigtable, & Dataproc to process and analyze data, to help create the pipelines required to handle millions of events daily, and collaborate with the data science team to enable the innovative work in machine learning and AI to be utilized in our production environment.Responsibilities:Contribute to the development of *** Micro Batch/Real Time streaming pipelines (lambda architecture)Work closely with the engineering team on data preprocessing and data structureAbility to lead and develop team of data engineersHelp mentoring the data engineering team and leading the data engineering initiativesCollaborate with key stakeholders to drive the architecture strategiesParticipate in architecture reviewsMaintain a culture of innovation, in an environment that requires high levels of scalability, security, and reliabilityQualifications:BA/BS or MS degree in Computer Science preferred, or equivalent work experienceUnderstanding of distributed data systemsPrevious leadership and team management experiencePrevious experience with Java and ScalaPrevious experience working with big data tools such as Bigtable, Apache Spark, Apache Spark Streaming, Apache Heron, BigQueryPreferred:Google Cloud, KubernetesExperience running production Golang systems, Infrastructure background, Low Latency / High Throughput Architectural System DesignStrong interest in data engineeringEagerness to learn new technologies on the fly and ship to productionKnowledge in data science is a plusExperience working on diverse teams a plus

Back to Job Search