USA_Engineer
Location: Seattle, WA (Onsite) Duration: 7 months Client: TCS Visa Restrictions: None Sub Vending: Yes Pay Rate: $55-$60/hr on C2C Bill Rate: $65-70
Skills:
- Microsoft Azure: Yes, 7+ years
- Databricks: No, 7+ years
- PySpark: No, 7+ years
- Python: No, 7+ years
Responsibilities and essential job functions include, but are not limited to, the following:
- Lead large-scale, complex, cross-functional projects to build the technical roadmap for the WFM Data Services platform.
- Review and approve design artifacts to ensure alignment with architectural standards.
- Build and own automation and monitoring frameworks that provide reliable, accurate, and easy-to-understand metrics and operational KPIs for data pipeline quality.
- Execute proof of concept (POC) on new technologies and tools to select the best solutions.
- Support business objectives by collaborating with business partners to identify opportunities and drive resolution.
- Communicate project status and issues to senior leadership and stakeholders.
- Direct project teams and cross-functional teams on all technical aspects of projects.
- Partner with engineering teams to build and support real-time, highly available data pipelines and technology capabilities.
- Translate strategic requirements into business requirements to ensure solutions meet business needs.
- Define and implement data retention policies and procedures.
- Define and implement data governance policies and procedures.
- Identify, design, and implement internal process improvements, including automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.
- Enable teams to pursue insights and applied breakthroughs while driving solutions to enterprise scale.
- Build infrastructure for optimal extraction, transformation, and loading (ETL) of data from a wide variety of structured and unstructured sources using big data technologies.
- Develop analytics tools that utilize data pipelines to provide actionable insights into customer acquisition, operational efficiency, and other key business performance metrics.
- Work with stakeholders, including Executive, Product, Data, and Design teams, to assist with data-related technical issues and support their data infrastructure needs.
- Perform root cause analysis to identify permanent resolutions for software or business process issues.
Basic Qualifications:
- Azure Data Engineer with 5+ years of experience designing and implementing scalable data pipelines using Azure and Databricks to support large-scale data processing and advanced analytics.
- Extensive experience building and optimizing ETL workflows using Databricks and PySpark to process and analyze massive datasets, ensuring high performance and data accuracy.
- 5+ years of experience with object-oriented or object-function scripting languages such as Python, Java, etc.
- 3+ years of experience leading development of large-scale cloud-based services with platforms like AWS, GCP, or Azure, and developing and operating cloud-based distributed systems.
- Experience building and optimizing data pipelines, architectures, and data sets.
- Ability to build processes supporting data transformation, data structures, and metadata management.