Data Engineer• 3 years of experience with programming languages Python, Scala, Bash scripting, and object-oriented programming concepts.• 1 years of experience with container-based platforms, including OpenShift, Kubernetes, and Docker.• 3 years of experience with RDBMS, including Teradata SQL and Teradata BTEQ. Also preferred ORACLE, and MySQL.• 3 years of experience with data modeling concepts and warehouse schemas.• 1 years of experience with NOSQL databases: MongoDB.• 3 years of experience with Hadoop echo system.• 1 years of hands-on experience with programming API and RESTful web services.• 3 years of experience with cloud environments, including Amazon Web Services or Google Cloud.• 3 years of experience with developer tools including BitBucket, Git and Bamboo. Also preferred Jenkins.• 2 years experience with job schedulers such as Airflow or Control-m.• 3 years of experience with Agile.Primary duties may include, but are not limited to:Design and develop ETL data pipelines for AI/ML models, applications, and supporting tools that enable data scientists to create algorithms/models in the big data ecosystem.Design, implement, and deliver insights data pipeline supporting analytic products across the organization.Integrate data from different sources.Develop analytics platform components and/or processing components required to provide business solutions.Engage with business stakeholders to design and own end-to-end solutions to empower data-driven decision-making.Leverage data, technology, and quantitative methods to build products that inject analytics and insights into the daily workflow of teams.Define application scope and objectives, including impact on interfaces.Ensure appropriate application testing is completed and meets test plan requirements.Coordinate integration actions to ensure successful implementation.Mentor team members.
Administer analytical projects and pilots for tool upgrades.Interpret big data/analytic projects that integrate large volumes of data, perform analysis, and recommend actionable insights.