Unknown Company

Big Data Engineer (Back fill) @ Remote, Richmond VA (C2C conract)

Remote • Posted 2 weeks ago

Remote Contract Computer and Mathematical Occupations

REQUIREMENT
Data Engineer (Back fill)
Remote / Richmond VA
Long term contract
Need Ex-Capital One consultants is MUST
Fast Path -Data Engineer(Backfill Role)
Main Skillset: Big Data engineering, Spark, Hadoop, Hive, HDFS, Kafka, AWS EMR and S3, ETL pipelines, distributed systems, NoSQL databases, and strong Java/Scala programming.
What Manager likes a true Big Data engineer who understands the internals of Spark and Hadoop, can optimize large pipelines, and has strong AWS and Java/Scala skills to deliver production-ready systems at scale.
Location, Richmond, or Remote is fine.
Job Description:
We are seeking a highly skilled Big Data Engineer with deep expertise in building, optimizing, and scaling data pipelines across distributed systems. The ideal candidate has hands-on experience with Spark , Hadoop , Hive , Kafka , AWS EMR , and S3 , along with strong programming skills in Java or Scala . This role requires someone who not only builds data workflows but also understands the internals of big data frameworks to deliver high-performance, production-ready solutions.
Key Responsibilities:

Design, develop, and optimize large-scale ETL pipelines using Spark , Hive , and Hadoop .
Implement and manage distributed data processing systems on AWS EMR , S3 , and related cloud data services.
Work with Kafka and streaming data frameworks to handle real-time data ingestion and processing.
Optimize performance of Spark jobs and Hadoop clusters to improve reliability and throughput.
Collaborate with data scientists, analysts, and product teams to deliver scalable and maintainable data solutions.
Develop data models and integrate structured and unstructured data using NoSQL databases.
Ensure best practices for data quality, governance, and security in the data engineering lifecycle.

Required Skills & Experience:

Strong programming skills in Java and/or Scala .
Deep understanding of Apache Spark internals , Hadoop architecture , and distributed computing concepts.
Hands-on experience with AWS services - EMR, S3, Lambda, and related tools.
Proficiency with Hive , HDFS , Kafka , and ETL frameworks .
Experience working with NoSQL databases (e.g., HBase, Cassandra, DynamoDB).
Proven ability to design, deploy, and optimize large-scale production data systems.

Preferred Qualifications:

Experience with Airflow or similar workflow orchestration tools.
Familiarity with CI/CD pipelines and data infrastructure automation.
Strong problem-solving skills and ability to tune large distributed systems for performance.

Big Data Engineer (Back fill) @ Remote, Richmond VA (C2C conract) in Remote at Unknown Company

This position is listed as contract and able to be worked remotely.

Back to Job Search