ETL Developer (SQL, Azure Cloud, Azure Data Factory)Position: ContractWork Hours: 8am-5pm HST preferred, but have flexibilitySalary: NAInterview Process:How many rounds? 3Video vs. phone?
VideoDescription:Functions may include database architecture, engineering, design, optimization, security, and administration; as well as data modeling, big data development, Extract, Transform, and Load (ETL) development, storage engineering, data warehousing, data provisioning and other similar roles.Responsibilities may include Platform-as-a-Service and Cloud solution with a focus on data stores and associated ecosystems.Duties may include management of design services, providing sizing and configuration assistance, ensuring strict data quality, and performing needs assessmentsAnalyzes current business practices, processes and procedures as well as identifying future business opportunities for leveraging data storage and retrieval system capabilities.Manages relationships with software and hardware vendors to understand the potential architectural impact of different vendor strategies and data acquisition.May design schemas, write SQL or other data markup scripting and helps to support development of Analytics and Applications that build on top of data.Selects, develops and evaluates personnel to ensure the efficient operation of the function.ETL Development, 3-6 Years, Competent;Summary of the project/initiative:Will implement, operate, enhance, and improve the Medicaid Datawarehouse solution that helps State of Hawaii aggregate and analyze Medicaid and HHS data.Awarded the initial contract in 2022 and scheduled to go-live in February, 2024.Our services will help Hawaii make decisions, reduce costs, and improve health outcomes for Medicaid and HHS programs.Team structure: 1 Account Manager 1 Project Manager 1 Data Architect 1 ETL Lead 2 ETL Developers 1 Business Analyst 1 System ArchitectTop 3 Skills:3+ years of experience in data warehousing concepts, ETL concepts, and working with ETL/Data quality tools on any ETL platform3+ years of experience in writing complex SQL queries, stored procedures and performance tuning1+ years of experience with Microsoft Azure cloud services and data warehouse environmentTop 5-10 Responsibilities:Develop and manage effective working relationships with other departments, groups, and personnel with whom work must be coordinated or interfacedEfficiently communicate with ETL architect while understanding the requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end usersAssist in the overall architecture of the ETL Design, and proactively provide inputs in designing, implementing, and automating the ETL flowsInvestigate and mine data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutionsDeveloping ETL pipelines and data flows in and out of the data warehouse using a combination of Azure Data Factory and Snowflake toolsetsDeveloping idempotent ETL process design so that interrupted, incomplete, or failed processes can be rerun without errors using ADF dataflows and PipelinesAbility to work in Snowflake Virtual Warehouses as needed in Snowflake and automate data pipelines using Snowpipe for tedious ETL problemsCapturing changes in data dimensions and maintaining versions of them using Stream sets in snowflake and scheduling them using TasksOptimize every step of the data movement not only limited to source and during travel but also when it's at rest in the database for accelerated responsesMust have the ability to build a highly efficient orchestrator that can schedule jobs, executing workflows, perform Data quality checks, and coordinate dependencies among tasksResponsible for testing of ETL system code, data design, and pipelines and data flows.