Big Data EngineerLocation: Remote/USADuration: 6-12+ MonthsJob Description:BS degree in computer science, computer engineering or equivalent5 – 6 years of experience delivering enterprise software solutionsProficient in Spark, Scala, Python, AWS Cloud technologies3+ years of experience across multiple Hadoop / Spark technologies such as Hadoop, MapReduce, HDFS, HBase, Hive, Flume, Sqoop, Kafka, ScalaFlair for data, schema, data model, how to bring efficiency in big data related life cycleMust be able to quickly understand technical and business requirements and can translate them into technical implementationsExperience with Agile Development methodologiesExperience with data ingestion and transformationSolid understanding of secure application development methodologiesExperienced in developing microservices using spring framework is a plusExperience in with Airflow and Python will be preferredUnderstanding of automated QA needs related to Big dataStrong object-oriented design and analysis skillsExcellent written and verbal communication skillsResponsibilities:Utilize your software engineering skills including Java, Spark, Python, Scala to analyze disparate, complex systems and collaboratively design new products and servicesIntegrate new data sources and toolsImplement scalable and reliable distributed data replication strategiesAbility to mentor and provide direction in architecture and design to onsite/offshore developersCollaborate with other teams to design and develop and deploy data tools that support both operations and product use casesPerform analysis of large data sets using components from the Hadoop ecosystemOwn product features from the development, testing through to production deploymentEvaluate big data technologies and prototype solutions to improve our data processing architectureAutomate everything