Data Engineering Team Member
Join our data engineering team that is embarking on a fortune 10 human capital digital transformation journey!
Responsibilities:
- Design, code, test, document, and maintain high-quality and scalable big data solutions.
- Ingest and transform data using a variety of technologies from a variety of sources (API’s, streaming, files, databases …).
- Develop reusable patterns and encourage innovation that will increase team’s velocity.
- Design and develop applications in an agile environment, deploy using CI/CD.
- Participate with prototypes as well as design and code reviews, own or assist with incident and problem management.
- The ideal candidate will be a self-starter who can learn things quickly, who is enthusiastic and actively engaged.
Required 3-5 years of experience with the following technologies:
- Hadoop, Python, Hive, SQL, shell scripting.
- Apache Spark.
- NoSQL and relational databases.
Required 1-3 years of experience with the following technologies:
- Scheduling tools like Airflow / Tivoli Work scheduler.
- Working in Agile/Scrum environment.
- Jenkins or similar CICD tool, GitHub.
Preferred 2-5 years of experience with the following technologies:
- Apache Kafka.
- API’s.
- Kubernetes.
Sr. Data Engineer (Spark, NoSQL, Hadoop, Python) | TELECOMMUTE | in Remote at Unknown Company
This position is listed as full time and onsite.