Unknown Company

Lead Hadoop Admin/Developer

belmont, ca • Posted 3 days ago
Hybrid Full Time General

Lead Hadoop Admin/DeveloperLocation: Foster City CA (Onsite – Hybrid)Duration: 6+ MonthsJob Description:Key skills required for Lead Hadoop Admin:• Hadoop (preferably Hortonworks/Open Distribution), HDFS, Hive, Kafka, Spark, Oozie/Airflow, HBase• Intermediate proficiency in SQL & HQL• Solid understanding of Linux, and scripting skills would be advantageous• Experience with Kerberos, TLS, Ranger, and data encryptionJD:· Basic to intermediate experience with Spark· Good experience with SQL. Should be able to understand and implement performance optimization.· Memory management experience· Queue allocation, distribution experience in Hadoop/Cloudera environments· Should be able to scale clusters in production and have experience with 18/5 or 24/5 production environments.· Good with one programming language.· Good exposure to Hive and Hadoop systems with exposure to monitoring tools. Sqoop, Oozie and other external tools.· Familiar with patch upgrades.

Back to Job Search