Data Engineer – (Hybrid)Location: Richmond, VA (hybrid: 3 days onsite, Mon–Thu; Friday remote). Rate: DOE (W2 Only) Position Type: Contract to )Seeking a Senior Java Developer to design and implement high-performance data processing applications. You will bridge the gap between traditional ETL and modern cloud-native big data ecosystems.
Technical stack: Core Development: Java, Scala, Python. Big Data: Spark (Core/SQL/Streaming), Ab Initio (ETL design & integration). Cloud: AWS (S3, EMR, Lambda, Glue).
Scripting/Automation: Shell Scripting (Bash), Python.Job ResponsibilitiesAb Initio, spark, scala AWS, python, shell scripting:Key Responsibilities:Develop scalable data pipelines using Spark and Scala within AWS.Integrate legacy Ab Initio workflows with modern cloud-based environments.Automate system tasks and deployments using Shell Scripting and Python.Optimize complex SQL queries and data transformations for maximum performance.Collaborate with stakeholders to translate business requirements into technical specs.