AWS Data EngineerAWS Data Engineer, Python, Spark, AWS Services, ETL, Glue, EMR, S3, Redshift, Airflow, Data Quality, CI/CD7+ years of experience in Amazon Web Services (AWS) Cloud Computing Strong background in designing, developing, and maintaining scalable data pipelines for ingestion and processing using Python, Spark, and AWS services Key Skills & ExpertiseETL Development: Implement and manage ETL processes using AWS Glue and EMR for both batch and streaming data Data Storage Solutions: Design and maintain storage solutions using Medallion Architecture in S3 and Redshift Workflow Orchestration: Monitor and optimize data workflows using Airflow or other orchestration tools Data Quality: Ensure accuracy, consistency, and integrity throughout the data lifecycle CI/CD: Implement and understand CI/CD practices for automated data pipeline deployment System Monitoring: Utilize CloudWatch and Datadog for performance monitoring and reliability Collaboration: Work closely with cross-functional teams to gather requirements and deliver business-driven data solutions Communication: Strong ability to communicate project updates and technical details to stakeholders.Please submit the candidate's resume in PDF format. Please remove the candidate's LinkedIn URL from the resume; otherwise, the profile will not be considered.San Francisco, California, United States ESR Healthcare
AWS Data Engineer (10737-1) San Francisco, CA in san francisco at Unknown Company
This position is listed as full time and onsite.