Data EngineerProvide a summary of the project/initiative which describes whats being done? Data Engineer will support the Optum Digital data enrichment initiative. The project has just started with bringing one web site click stream data to Optum platform. We have requirement for 67 website enrichments.What does the ideal candidate background look like (ex: healthcare specific background, etc.)?
Experience Azure developer. Expert in SQL Queries.
Experience with Adobe Clickstream, Data bricks, TableauWhat experience will set candidates apart from one another?
Experience in Azure and data bricks or Experience with AWS Data bricks. Excellent in writing/understanding complicated queries.Are you open to candidates that would need to be 100% remote for the duration of the engagement? Yes.Responsibilities: Build and deploy performance and scalable solutions by applying data engineering concepts and development best practices Build scalable and end to end Spark pipelines for large-scale healthcare data Ensure high quality solutions by design and build unit tests, integration test, performance test and user acceptance tests Optimize data pipelines to handle growing data volumes Collaborate on designs for data pipelines and data tooling that meet performance and data quality standards Build methods and tools to automate development activities Ability to prioritize tasks and work concurrently on multiple tasks Participate in business analysis and data discovery to gather data requirements Ability to build complex but compact well performing SQL queries.