Onsite Lead Data EngineerLocation: Tarrytown, NY (100% onsite)Duration: 6+ MonthsJob Description:Location: 777 Old Saw Mill River Rd, Tarrytown, NY 10591 (100% onsite role) – Ideal to look for local profiles.Candidate should have 12+ years of experience in Data EngineeringDesigning, creating, testing and maintaining the complete data management & processing systems.Working closely with the stakeholders & solution architect.Building highly scalable, robust & fault-tolerant systems.Knowledge of Hadoop ecosystem and different frameworks inside it – HDFS, YARN, MapReduce, Apache Pig, Hive, Flume, Sqoop, ZooKeeper, Oozie, Impala and KafkaMust have knowledge and working experience in Real-time processing Framework (Apache Spark), PySpark and in AWS Redshift, Apache Airflow and EMRMust have experience on SQL-based technologies (e.g. MySQL/ Oracle DB) and NoSQL technologies (e.g. Cassandra and MongoDB)Should have Python/Scala/Java Programming skillsDiscovering data acquisitions opportunitiesFinding ways & methods to find value out of existing data.Improving data quality, reliability & efficiency of the individual components & the complete system.