Data EngineerMust have 1. 8+ years of overall experience 2. Strong in Hive and Impala query languages 3. Data warehousing skills such as creating and maintaining data models 4. Ability to troubleshoot long running Hive/Impala queries and optimize the performance (prior experience in this is a must) 5. Hands on experience in Python with good coding standards 6.
Experienced in GIT, Jenkins and Jira platforms 7. Expertise in shell scripting 8. Hands on experience in Apache Spark 9.
Experience in developing ETL scripts using Python, PySpark and shell scripts 10. Job scheduling with cron 11.
Experience in Cloudera Enterprise Platform and components Added advantage 1. Prior experience in SAP to Hadoop data migration 2.
Experience/knowledge in Attunity 3.
Experience/knowledge with AtScale 4.
Experience/knowledge with RedWood 5.
Experience/knowledge in Solr indexing Solr Hadoop integration