C2H Kafka ResourceLocation: Richardson, TX or Buffalo Grove, IL (Must sit onsite 2-3 days / wk)Skills SetAdministration of Confluent Kafka infrastructureKafka brokers, Producer, Consumers, zookeepers, Kafka connect, schema registry, KsqlDB, Kafka streams.Monitoring and setup using Prometheus, Grafana and confluent control CentreScripting using Shell and PythonInfrastructure as Code- TerraformCI/CD using JenkinsKnowledge on GCP/AWS/Azure CloudManaged/Custom Kafka connectors configurationKafka development experience with Microservices/java/j2ee frameworks.Roles and ResponsibilitiesLeading and Architecting Confluent Kafka applicationCreating Kafka topics and providing required access to the Producer Application to publish messages to the Kafka topic.Providing appropriate access to the consumer group to consumer messages from Kafka topic for Consumer Application.Diagnosing, Troubleshooting, and solving Kafka issues and maintaining the documentation for the same.Developing middleware integration solution for enrichment or transformationDeploying Source and Sink connectors on self-managed Virtual Machines (VM) based on the client’s needsBuild data pipelines with Kafka connect/connectors to deploy and support Kafka Data stream processing.Setup monitoring tool Prometheus, Grafana and confluent control CentreConfigure Grafana dashboard to monitor Confluent Kafka cluster and providing access to the requested users.Setup alerts for Kafka Consumer Lags and other issues.Responsible for implementation and ongoing administration of Confluent Kafka infrastructure.