Unknown Company

Data Engineer with streaming

san diego, ca • Posted 4 days ago
Onsite Full Time General

Data EngineerLocation: MTV/San Diego CA (100% Onsite)Job Description:Expertise in Apache Flink or streaming expStrong programming skills in JavaKnowledge of stream processing and batch processingExperience working with Apache Kafka.Proven experience with projects in Apache Flink production Java or ScalaKnowledge of relational databases.Knowledge of MPP like AWS AthenaKnowledge of HIVEExperience of AWS cloud services.What You'll Do:Work on writing new data pipelines.Debug and optimize existing data pipelines.Analyse pipelines consuming high resources or having high execution time and optimize as neededImplementation for automating pipeline management and metrics setup for observabilityGather requirements, work on high level design, implement (code) and deliver efficient and scalable DW solutions in high data growth environmentOversee team activities related to coding, unit testing, system testing, resolve defect originating during system test and deploy the fixes for the defects when neededGood to Have:Familiarity with big data technologies like Spark, HiveFamiliarity with CI/CD and basic dev ops.

Back to Job Search