Sr. Data Engineer (Kafka and Spark)Visa status: U.S. Citizens and those authorized to work in the U.S.
are encouraged to apply. Tax Terms: W2, 1099 Corp-Corp or 3rd Parties: YesLocation: San Antonio, TX or NJExp: 12+ yearsRequirement:Experience of designing, building, and deploying production-level data pipelines using tools (HDFS, Hive, Spark, HBase, Kafka, NiFi, tc.).Must have strong experience working on Event Driven ArchitectureProvide expertise in Kafka brokers, zookeepers, KSQL, KStream and Kafka Control centerMust have strong knowledge of the Kafka Connect framework, with experience using several connector types HTTP REST proxy, JMS, File, SFTP, JDBC etcProvide expertise and hands on experience on custom connectors using the Kafka core concepts and APIMust have implementing KAFKA consumer to read data from KAFKA Partitions. K-SQL, API,Kafka Security (SSL SASL Kerberos ACL),Elasticsearch and advance configurationMust have experience in handling huge volumes of streaming messages from KafkaMust have experience Kubernetes/OpenShift (AWS Elastic Kubernetes Service, Azure Kubernetes Service, Red Hat OpenShift preferred )Comfortable building services with a CI/CD pipeline, CircleCI, Jenkins,Experience with NiFi and understanding of flow-based programming desired.Experience in Java preferredGood to have experience in Snowflake DBExperience:Bachelor's Degree or master's degree in Computer Science, Mathematics, Statistics.5-7 years of real time kafka experience (Preferred).3 years of KSQL and Kafka Connect experience (Preferred).8-10 years of Java experience.2-4 years of NiFi experience.2-4 years Kubernetes/OpenShift.