Big Data DeveloperEmployer: HCL Global Systems Inc.Job Duties:Defines and plans data base architecture for enterprise systems. Responsible for enterprise-wide data design, optimization, and resource utilization. Ensure architectural integrity and consistency across the entire project.
Participate in technical solutions planning and requirements gathering phases including design, development, unit testing, troubleshooting and documenting big data –oriented software applications and follow Agile (SCRUM) methodology. Responsible for development of full/transnational feeds, build enterprise applications and components utilizing big data platform Eco stack – Hortonworks, Hadoop, Hive, Oozie, HBase, Elasticsearch, Spark, Scala, Python, Java and RESTAPI's. Design, Develop and enhance new/existing data ingestion pipelines by connecting actual sources and build a similar ETL Data Warehouse in Hortonworks Hive data warehouse, NoSQL Database (HBase, Elasticsearch) databases, table and views.
Develop build and deploy Generic feeds monitoring and alert notifications to track jobs and workflows using Oozie, Unix shell scripting or Splunk Monitoring Tools.Technologies used: Hadoop, HDFS, Hive, Sqoop, HBase, Elasticsearch, Kafka, Pulsar, Apache NiFi Flume, Storm, Spark, Zeppelin, Tensor Flow, Phoenix, Hortonworks, Java/J2EE, Scala, Python, UNIX, Shell-scripting, Oracle, PostgreSQL, MySQL, and Teradata, Eclipse, IntelliJ, Jira, GIT, Maven and SBT, Jupiter notebook, Tableau, QlikView's, Kibana, SonarQube.Work Location: Various unanticipated work locations throughout the United States; relocation may be required. Must be willing to relocate.Minimum Requirements:Education: Minimum of a Bachelor's degree or its equivalent in Computer Science, Information Systems or a related fieldExperience: NoneJob Order No: .***This position is eligible for a referral bonus through our employee referral program***