Data Engineer (BigQuery, DataProc, DataFlow)Location: Dallas, TX (Hybrid)Hire Type: ContractThe ideal resource would be local to the Dallas, TX area so they could be in office 1-2 days per week.They would have extensive experience on BigQuery, DataProc and DataFlow platforms on Google Cloud platform. Having experience on Azure Databricks is an added advantage (not mandatory).Programming experience on Python, Shell scripting, PySpark and other data programming language.Programming experience on Apache Beam Java SDK for building effective heavy data pipelines and deploying them in GCP DataFlow.CICD process to deploy these pipelines in GCP.Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.Experience on Cluster capacity configurations and cloud optimization to meet application demand.Programming experience on Python, Shell scripting, PySpark and other data programming language.Programming experience on Apache Beam Java SDK for building effective heavy data pipelines and deploying them in GCP DataFlow. CICD process to deploy these pipelines in GCP.Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Strong analytic skills related to working with Data Visualization Dashboard, Metrics and etc.Build processes supporting data transformation, data structures, metadata, dependency and workload management.A successful history of manipulating, processing and extracting value from large disconnected datasets.Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.Familiar with Deployment tool like Docker and building CI/CD pipelines.Experience supporting and working with cross-functional teams in a dynamic environment.8+ years' experience in software development, Data engineering.Bachelor's degree in computer science, Statistics, Informatics, Information Systems or another quantitative field.
Postgraduate/master's degree is preferred.Experience in Machine Learning and Data Modeling is a plus.Top 3 skills needed/required:Extensive Experience on BigQuery, DataProc and DataFlow platforms on Google Cloud platform. Having experience on Azure Databricks is an added advantage (not mandatory).Programming experience on Python, Shell scripting, PySpark and other data programming language.Programming experience on Apache Beam Java SDK for building effective heavy data pipelines and deploying them in GCP DataFlow. CICD process to deploy these pipelines in GCP.What makes a resource profile stand out to you?Previous experience tenure with prior clientsGood hands-on experience on prior assignmentsWhat will this person’s day-to-day responsibilities be?Handling business requirements and delivering them on Agile methodology.How will they contribute to the project?Handling business requirements and delivering them on Agile methodologyIf hybrid or in office role, how many days a week will the resource need to come into the office?1 or 2 days per weekPlease note that resources who will be working in Bentonville, AR, Reston, VA or some Texas locations must have a VendorSAFE background check completed.Does this contract have the opportunity to extend or convert to an FTE?YesAlong with the required skills, it would be great if we can have profiles that are currently working somewhere or have just recently finished their assignment.We are also looking for candidates with at least 7-8 years or experience or more in Big Data.