Senior Data Engineer100% telecommute.You will put your Data Engineering skills to work as you empower business partners and team members to improve healthcare delivery. You will research cutting edge big data tools, and design innovative solutions to solve business problems that only a Data Engineer can. You'll be in the driver's seat on vital projects that have strategic importance to our mission of helping people live healthier lives. Yes, we share a mission that inspires.
And we need your organizational talents and business discipline to help fuel that mission.You will be part of the team who is focused on building a cutting-edge data analytics platform to support reporting requirements for the business. As a Senior Data Engineer, you will be responsible for the development of complex data sources and pipelines into our data platform (i.e. Snowflake) along with other data applications (i.e. Azure, Airflow, etc.) and automation.
This is a fully remote role based in the United States. Your counterpart team is located in Dublin, Ireland office. While there is no requirement to work in shift hours, there might be an occasional call with Dublin team which can require flexible working.Responsibilities:Create & maintain data pipelines using Azure & Snowflake as primary toolsCreate SQL Stored procs, Macros to perform complex transformationCreating logical & physical data models to ensure data integrity is maintainedCI CD pipeline creation & automation using GIT & GIT ActionsTuning and optimizing data processesDesign and build best in class processes to clean and standardize dataCode Deployments to production environment, troubleshoot production data issuesModelling of big volume datasets to maximize performance for our BI & Data Science TeamCreate Docker images for various applications and deploy them on KubernetesRequired:Computer Science bachelor's degree or similarMin 3-6 years of industry experience as a Hands-on Data engineerExcellent communication skillsExcellent knowledge of SQL, PythonExcellent knowledge of Azure Services such as – Blobs, Functions, Azure Data Factory, Service Principal, Containers, Key Vault etc.Excellent knowledge of Snowflake - Architecture, best practicesExcellent knowledge of Data warehousing & BI SolutionsExcellent Knowledge of change data capture (CDC), ETL, ELT, SCD etc.Knowledge of CI CD Pipelines using GIT & GIT ActionsKnowledge of different data modelling techniques such as Star Schema, Dimensional models, Data vaultHands on experience on the following technologies:Developing data pipelines in Azure & snowflakeWriting complex SQL queriesBuilding ETL/ELT/data pipelines using SCD logicExposure to Kubernetes and Linux containers (i.e. Docker)Related/complementary open-source software platforms and languages (e.g.
Scala, Python, Java, Linux)Previous experience with Relational Databases (RDBMS) & Non- Relational DatabaseAnalytical and problem-solving experience applied to a Big Data datasetsGood understanding of Access control and Data maskingExperience working in projects with agile/scrum methodologies and high performing team(s)Exposure to DevOps methodologyData warehousing principles, architecture and its implementation in large environmentsVery good understanding of integration with TableauPreferred:Design and build data pipelines (in Spark) to process terabytes of dataVery good understanding of Snowflake integration with data visualization tool such as TableauOrchestrate in Airflow the data tasks to run on Kubernetes/Hadoop for the ingestion, processing and cleaning of dataTerraform knowledge and automationCreate real-time analytics pipelines using Kafka / Spark StreamingWork on Proof of Concepts for Big Data and Data ScienceUnderstanding of United States Healthcare dataRequired Skills: Snowflake, Azure Additional Skills: Azure Engineer