Senior Big Data / Hadoop DeveloperGenesis10 is currently seeking a Senior Big Data / Hadoop Developer for a contract position with a Global Financial Institution located in Pennington, NJ. This is a 12+ month contract opportunity.We are looking for a highly skilled Hadoop Developer to join a data engineering team. You will be responsible for building, optimizing, and maintaining scalable data pipelines within the Hadoop ecosystem.
The ideal candidate will have extensive experience in ETL processing, data warehousing concepts, and optimizing large-scale distributed data architectures.Responsibilities:Design, develop, and maintain robust data processing jobs using Hadoop (HDFS, MapReduce, Hive, Spark)Architect and implement complex ETL/ELT pipelines to ingest, transform, and load large-scale structured and unstructured dataFine-tune performance for distributed queries and data processing tasks to ensure high efficiency in a multi-tenant environmentTranslate business requirements into logical and physical data models suitable for big data analyticsImplement data validation and reconciliation processes to ensure high data integrity and reliabilityTroubleshoot production data issues, resolve pipeline bottlenecks, and manage system upgrades within the Hadoop stackMentor junior developers and enforce coding standards and best practices for big data developmentRequirements:Strong hands-on experience with Hive, Spark, HDFS, and Oozie or AirflowDeep experience in designing end-to-end ETL processes using Python, Scala, or Java, and SQLProficiency in processing large datasets (Petabyte scale) and understanding partition strategies, file formats (Parquet, Avro, ORC), and compression techniquesExpert-level knowledge of complex SQL queries, window functions, and performance tuningDesired skills:Experience with Starburst (Trino) for high-performance distributed SQL queries and federated query engines is a significant plusFamiliarity with migrating or running Hadoop workloads on cloud platforms (AWS EMR, Databricks, or Google Dataproc)Knowledge of tools like Ranger, Atlas, or similar metadata management toolsPay range: $55.06 - $63.06 per hourOnly candidates available and ready to work directly as Genesis10 employees will be considered for this position. If you have the described qualifications and are interested in this exciting opportunity, please apply!
Senior Big Data / Hadoop Developer in pennington at Unknown Company
This position is listed as contract and onsite.