Unknown Company

Lead Data Engineer with PySpark

charlotte, nc • Posted 5 days ago
Onsite Full Time General

Lead Data Engineer With PySparkMount Laurel Township, NJ, United StatesLead Data Engineer With PySparkRequisition Title: Lead Data Engineer With PySpark (1 Day Onsite)Locations: Mt Laurel, NJ & Charlotte, NCVisa Status: GC/USC/H4 EADClient: TD BankDuration: Full Time /C2HSalary pay rate to candidates: $49-$56/hr W2Experience: 12+ YearsPrimary Tech skills = Pyspark, Databricks (Hands-on experience mandatory)Secondary Tech skills = Azure, SAS, Synapse, DatabricksMUST HAVE SKILLS:Techno-Managerial covers the entire life cycle of data warehouse and data cloud environment with experience in building data platforms development.Technical co-ordination with Product Group Technical Lead, Architecture team, Data engineering team, BSA, and QE Team for the assigned projects.Ability to drive more than one project in parallel.Experience in building end to end architecture for Data Lakes, Data Warehouses and Data MartsExperience of DWH, Data Integration, Cloud, Architecture, Design, Data ModellingHands-on experience in Pyspark is a must.Experience working with structured and unstructured data.Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologiesExperience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements.Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL ServerExperience with Orchestration tools and GitHubExperience to own end-to-end development, including coding, testing, debugging and deployment.Must be team oriented with strong communication, collaboration, prioritization, and adaptability skillNeed to be an individual performer as well as a Lead.

Back to Job Search