We are seeking an experienced AWS Data Platform & AI Infrastructure Engineer with 5–8 years of experience in AWS infrastructure, data platforms, DevOps, and AI workloads.
Must-Have Skills
- Strong experience with AWS S3, Glue, Athena, and EMR.
- Hands-on experience with Terraform and AWS Infrastructure as Code.
- Strong knowledge of VPC, IAM, Security Groups, VPC Peering, PrivateLink, and Transit Gateway.
- Experience with Docker, GitLab CI/CD, and Artifactory.
- Experience supporting Scala/Spark ETL pipelines.
- Proficiency in Python, Linux, and Shell scripting.
- Experience with CloudWatch, Prometheus, or Grafana.
- Experience with REST APIs and AWS SDK/boto3.
- Strong understanding of CI/CD, Git workflows, automated testing, and software engineering practices.
- Experience with event-driven systems such as Kafka, SNS/SQS, or EventBridge.
AI / Data Platform Experience
- Experience supporting AI agent runtime environments.
- Experience with LangGraph and LangSmith Deployments is preferred.
- Experience with cloud-based data lake and distributed data processing environments.
Responsibilities
- Design and manage AWS infrastructure for Data Lake and AI workloads.
- Manage cross-account connectivity, networking, IAM, and security.
- Build and maintain CI/CD pipelines for AI agent deployments.
- Support and troubleshoot Scala/Spark ETL pipelines and onboard new data sources.
- Implement monitoring, alerting, automation, and incident response.
- Develop reusable infrastructure and automation using Terraform and Python.
- Collaborate with engineering teams and external platform owners on connectivity, security, and access requirements.