Big Data EngineerLocation: Atlanta, Georgia (Need local candidates)Job Type: C2CRequired Experience: 10+Visa Type: Any visa is workableSkills and Experience:6+ years of overall IT experience3+ years of experience with high-velocity high-volume stream processing: Apache Kafka and Spark StreamingExperience with real-time data processing and streaming techniques using Spark structured streaming and KafkaDeep knowledge of troubleshooting and tuning Spark applications3+ years of experience with data ingestion from Message Queues (Tibco, IBM, etc.) and different file formats across different platforms like JSON, XML, CSV3+ years of experience with Big Data tools/technologies like Hadoop, Spark, Spark SQL, Kafka, Sqoop, Hive, S3, HDFS, or3+ years of experience building, testing, and optimizing ‘Big Data’ data ingestion pipelines, architectures, and data sets2+ years of experience with Python (and/or Scala) and PySpark/Scala-Spark3+ years of experience with Cloud platforms e.g. AWS, GCP, etc.3+ years of experience with database solutions like Kudu/Impala, or Delta Lake or Snowflake or BigQuery2+ years of experience with NoSQL databases, including HBASE and/or CassandraExperience in successfully building and deploying a new data platform on Azure/ AWSExperience in Azure / AWS Serverless technologies, like, S3, Kinesis/MSK, lambda, and GlueStrong knowledge of Messaging Platforms like Kafka, Amazon MSK & TIBCO EMS or IBM MQ SeriesExperience with Databricks UI, Managing Databricks Notebooks, Delta Lake with Python, Delta Lake with Spark SQL, Delta Live Tables, Unity CatalogKnowledge of Unix/Linux platform and shell scripting is a mustStrong analytical and problem-solving skillsPreferred (Not Required):Strong SQL skills with ability to write intermediate complexity queriesStrong understanding of Relational & Dimensional modelingExperience with GIT code versioning softwareExperience with REST API and Web ServicesGood business analyst and requirements gathering/writing skills