Kafka DeveloperLocation: Charlotte, NCMust have skills:Kafka DevelopmentHadoop DevelopmentPython ScriptingScala DevelopmentSpark DevelopmentMinimum years of experience required: 8+Duration of the project: 6 monthsVisa dependent candidates: OKIn-person interview: No (video)Skype/WebEx interview: OKEducation qualification required:Bachelor's Degree or foreign equivalent, will consider work experience in lieu of a degree4+ years of experience with Information Technology3+ years in Kafka programming, working knowledge around Big Data (Hadoop, Hbase, Hive, Scala, Spark, Python etc.)Experience building and optimizing 'big data' data pipelines, architectures and data sets using Kafka.
Experience in Core Java/OOPS.Experience in Apache/Confluent Kafka components (Connect, Schema, Registry, KSQL, ControlCenter, brokers, KStream)Provide expertise and hands on experience working on Kafka connectors such as MQ connectors, Elastic Search connectors, JDBC connectors, File stream connector, JMS source connectors, Tasks, Workers, converters, Transforms.Create stubs for producers, consumers and consumer groups for helping onboard applications from different languages/platforms. Leverage Hadoop ecosystem knowledge to design, and develop capabilities to deliver solutions using Spark, Scala, Python, Hive, Kafka and other things in the Hadoop ecosystem.Build processes supporting data transformation, data structures, metadata, dependency and workload management.A successful history of manipulating, processing and extracting value from large disconnected datasets. Working knowledge of message queuing, stream processing and highly scalable 'big data' data stores.Good experience in end-to-end implementation of DW BI projects, especially in data warehouse and mart developmentsStrong knowledge and hands-on experience in Unix shell scriptingKnowledge and experience with full SDLC lifecycleExperience supporting and working with cross-functional teams in a dynamic environment.Independently able to debug and support to prod support team as and when requiredExperience with Lean / Agile development methodologies