Unknown Company

IT-Sr Principal Data Engineer/30/TEC048

raleigh, nc • Posted 4 days ago
Remote Full Time General

Senior Data Integration EngineerThis specific position will be supporting the implementation of streamed/event driven data from Kafka through an ETL process built on Azure DeltaLake via Databricks to create a golden member record persisted in Cosmos DBLOCATION: Open to fully remote for the right candidate.PROJECT: Commercial cloud (Azure) based data ingestion engine that is highly performant- scalable and elastic and transforms and stores Delivery Organization member, clinical data.TOP REQUIREMENTS: ETL (Delta Lake)Function Description:Functions may include database architecture, engineering, design, optimization, security, and administration; as well as data modeling, big data development, Extract, Transform, and Load (ETL - data ingestion pipeline leveraging Delta Lake on Databricks) development, storage engineering, data warehousing, data provisioning and other similar roles.Evaluating the performance and applicability of multiple tools against customer requirementsResponsibilities may include management of design services, providing sizing and configuration assistance, ensuring strict data quality, and performing needs assessments.Analyzes current business practices, processes and procedures as well as identifying future business opportunities for leveraging data storage and retrieval system capabilities.Manages relationships with software and hardware vendors to understand the potential architectural impact of different vendor strategies and data acquisition.May design schemas, write SQL or other data markup scripting and helps to support development of Analytics and Applications that build on top of data.

Back to Job Search