Unknown Company

AWS Data Tech Lead

san mateo, ca • Posted 4 days ago
Onsite Contract General

AWS Data Tech LeadLocation: Foster City, CA (Onsite) Duration: Fulltime / C2H Contract Experience: 9+ YearsPrimary (Must Have Skills)AWS, S3, RedShift, Glue, PySpark, SQLJob DescriptionExperience in building data solutions with AWS technologies: storage, pipelines, ingestion, job scheduling, notifications/alerts, loggingExperience in data processing: full/incremental, batch/real-time/near-real-time, event drivenExperience building data solutions using AWS services such as Redshift, RDS, MWAA, Glue, S3, SQS, SNSProficiency in Python 3.6+, PySpark, SQLProficiency in Databricks and Medallion architecture on AWS platformImplementing jobs monitoring with Amazon CloudWatchExperience deploying applications using Terraform or a similar IaC toolExperience building CI/CD pipelines using GitHub Actions or a similar toolProficiency in managing code as part of a team using GitHubFamiliarity with agile development methodologiesExperience building data-driven unit test suites for data platformsExperience with Domain Driven Design for data modellingGood to haveExperience in the biotechnology/biopharmaceutical industryKnowledge of SRE/Observability practicesArchitecting high performant and scalable data engineering solution with Databricks on AWS data platformArchitecting data solutions in Medallion data architecture definition and process for a Data Lake, Lakehouse, DW, analytical martsProficiency in data mesh architecture; data domain driven distributed/decentralized data solution, governance for data federationArchitect and design data pipeline patterns with aspects of process audit, data quality, cost optimized designPerform data analysis and define data modelsSetup connections and structure for the development componentsKnowledge of data governance and security solutions with regulatory compliance requirements

Back to Job Search