Data Integration EngineerLocation: Hybrid in Worcester, MA 3days/week (Local or from nearby states who can relocate on day 1) Duration: 6+ months CTH MoI: 2 Video and F2F for local or within drivable distance candidatesData engineering is the aspect of data science that focuses on practical applications of data collection and analysis. This role will primarily become proficient with all internal & external data produced and consumed by THG. The engineer will understand where the data is, basic data models and architecture, how to access and obtain data, and how to manipulate and work with data to produce output, which may be reports, datasets, or self-service reports.
The ideal candidate is a self-motivated, adaptable, and composed collaborator who can learn quickly.Responsibilities & Essential FunctionsThis role will be driving larger, more complicated projects independently, as well as mentoring less experienced engineers. Data Engineer will collaborate with business partners and cross-functional teams on data/reporting requests. The assignments will become broader in nature, usually requiring originality and ingenuity.
This role will be accountable for successful outcomes related to designing, developing, implementing, optimizing, and maintaining data integrations, pipelines, and solutions.Skills, Experience, and QualificationsSkills:Mandatory: Java, JDBC Template, JPA, Springboot, Ehcache, SQL, REST.Proficiency in the following languages: Java, SQL, Python, and Scala (prioritized order)Data Modeling: Creation of conceptual, logical, and physical data models for data objects, object attributes, and their relationshipsAnalytical Skills: Data Engineers work with large amounts of data that will include facts, figures, and number crunching. You will need to profile the data and analyze it to find conclusions.Communication Skills: Data engineers are often called to present their findings or translate the data into an understandable document. You will need to write and speak clearly, easily communicating complex ideas.Critical Thinking: Data engineers must look at the numbers, trends, and data and come to new conclusions based on the findings.Attention to Detail: Data engineers must make sure they are vigilant in their analysis to come to correct conclusions.Math Skills: Data engineers need advanced math skills to estimate numerical data.Insurance experience required, as well as insurance products.Debugging Skills: Data engineers need the ability to analyze issues with components in our data solutions and come up with remediation plans.Experience:Experience in Java development with Java 8 & above, J2EE, Hibernate, Maven, GiT, Jenkins, JSON frameworks, XML, JMS, JDBC, Junit-based testing frameworks like MockitoDemonstrated proficiency in Spring Framework, including Data (JDBC, ORM, JMS), Security &IntegrationProven experience in data engineering, implementation of best practices for data storage, integration, transformation, access, etc., within Azure and on-premise platformsExperience in building and optimizing real-time and near-real-time data integration solutions for scale, performance, reliability, and cost efficiencyExperience with event streaming solutions like Apache Kafka and/or near real-time messaging Solutions such as Azure Service Bus are preferred.Experience in optimizing data pipelines to account for scale, performance, reliability, and cost efficiency is preferredDemonstrated proficiency in relational, NoSQL, hierarchical, and entity relationship data modelingExperience in creating easy-to-consume documentation of data processes and solutions to aid in knowledge transfer and continuity.Experienced in agile development methodologies, developing high-quality code, and DevOps best practicesStrong foundations with core Java concepts.
Good understanding of Aspect Oriented Programming (AOP), Test Driven Development (TDD)Solid grasp of HTTP, RESTful web services, Linux operating systemsCoaching and mentoring less senior team member as well as conducting reviews for their workQualifications:Bachelor's degree or higher in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent5 plus years of professional experience in data engineering, data architecture, and data integration5 plus years of professional experience in Java development and Spring FrameworkPREFERRED: Holds active Azure DP-203 (Microsoft Certified: Azure Data Engineer Associate) or equivalent. Other Azure DP certifications or equivalents are also applicable