Sr. Data EngineerOur leading Fortune 100 Financial Services client is looking to bring on a Sr, Data Engineer to assist with several business critical pushes. In this role you will be contributing a specific line of business of our clients and developing new best practices in data movement and transformation.Responsibilities:Partner with product owners, peers, and end-users to understand business requirements and identify risk/issues in a timely manner and escalate as necessary.Be the intersection with lines of business, Finance and technology.
The ability to understand various perspectives is critical when optimizing an engineering solutionProvide technical guidance concerning business implications of application development projectsLeverage ETL programming skills in open source languages including Python, Scala and SQL on various frameworks especially Apache SparkDeploy DevOps techniques and practices like Continuous Integration, Continuous Deployment, Test Automation, Build Automation and Test-Driven Development to enable the rapid delivery of working code utilizing tools like Jenkins, Nexus, Git and DockerManage multiple responsibilities in an unstructured environment where you're empowered to make a difference. In that context, you will be expected to research and develop cutting edge technologies to accomplish your goalsRequired Skills:7 + years of related experienceSolid understanding and experience in big data solutions using open-source languages such as Python and Scala on Apache Spark frameworkExperience working on data projects and data management involving querying databases and/or transforming legacy data platforms to future data streaming platforms. Solid understanding and experience in the following scripting languages.
(e.g Unix shell scripting, perl etc)Solid understanding and experience in Cloud computing, preferably AWS and its services including S3, EMR/EC2 and Lambda functionsDesired Skills (not required but candidate will have exposure to these skills in this role):10+ years of related experience to go along with technical degreeApplicable certifications (AWS, Azure, etc)Experience working in Financial Services industry