Data Engineering Solutions PartnerPartners with the business to operationalize data engineering solutions and deliver insights to the business. Provide innovative technology solutions to our business partners to deliver data driven insights and understanding of the behaviors that drive investor success. Interfaces with cross functional team members, and communicates systems issues at the appropriate technical level for each audience.
Is highly functional on large, matrixed project teams. Interfaces with cross functional team members, including database administrator, IT security, project manager, technical writer, and clients. Communicates systems issues at the appropriate technical level for each audience.
Willingness and enthusiasm for learning and experimenting with new technology, tools and processes. Maintains flexibility in meeting deadlines and expectations in the face of shifting priorities.Required Skills:Good understanding of lean principles, including Shift left, DevOps, CloudOps, DataOps, continuous delivery; must have experience with Maven, Cucumber testing, Bamboo, git,Strong understanding of the use and application of NGA tools, web-services, etc.Worked on cloud architecture such as AWS, MS Azure, etc. and related Big Data technologies (AWS EMR, S3, Glue ETL, Cloud Formation templates, Cloud Watch Logs, Splunk, Ansible, etc.)Working knowledge of data streaming services such as Flume, Kafka, AWS Kinesis, etc.Familiarity with Machine Learning (ML), NLP, Robotic, and AI concepts would a plus, especially around the use and application of such technologies to provide value add services to our clients.Strong experience with scripting languages and platforms such as Python, Spark, R, SQL, Scala, etc.Experience with leveraging APIs and micro-services for serving and managing data on AWS.
Use and application of API Management technologies, such as AWS API Gateway, RESTful APIs, Route 53, AWS Lambda, web services, etc.