Big Data Architect (Spark Streaming)Visa status: U.S. Citizens and those authorized to work in the U.S. are encouraged to apply.
Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: YesQualifications12+ years of total IT experience including 3+ years of Big Data experience (Hadoop, Spark Streaming, Kafka, Spark SQL, HBase, Hive and Sqoop). Hands on experience on Big Data tools and technologies is mandatory.Proven experience of driving technology and architectural execution for enterprise grade solutions based on Big Data platforms.Designed at least one Hadoop Data Lake end to end using the above Big Data Technologies.Exp in designing Hive and HBase Data models for storage and high-performance queries.Knowledge of standard methodologies, concepts, best practices, and procedures within Big Data environment.Proficient in Linux/Unix scripting.Bachelor's degree in Engineering - Computer Science, or Information Technology. Master's degree in Finance, Computer Science, or Information Technology a plus.Experience in Agile methodology is a must.Experience in Storm and NoSQL Databases (e.g.
Cassandra) is desirable.Knowledge on Oracle or any other RDBMS experience is desirableFamiliarity with one of the leading Hadoop distributions like Hortonworks, Cloudera, or MapR is desirable.Exposure to infrastructure as service providers such as: Google Compute Engine, Microsoft Azure or Amazon AWS is a plus.Self-starter and able to independently implement the solution.Good communication skills and problem-solving techniquesJob DescriptionDefine big data solutions that leverage value to the customer; understand customer use cases and workflows and translate them into engineering deliverablesArchitecting and Designing Hadoop solution.Actively participate in Scrum calls, work closely with product owner and scrum master for the sprint planning, estimates and story points.Break the user stories into actionable technical stories, dependencies and plan the execution into sprints.Designing batch and real time load jobs from a broad variety of data sources into Hadoop. And design ETL jobs to read data from Hadoop and pass to variety of consumers / destinations.Perform analysis of vast data stores and uncover insights.Responsible for maintaining security and data privacy, creating scalable and high-performance web services for data tracking.Propose best practices / standards and implement them in the deliverables.Analyze the long running queries and jobs, performance tune them by using query optimization techniques and Spark code optimization.Skills APPS-NICHE-BIGDATA-HADOOP