Senior Data Migration Developer

Data Migration Developer (Netezza to Snowflake)Location: Remote Duration: 6 Months of ContractMust-Have Skills:Strong hands-on experience with Python or Jython scripting for data extraction and synchronizationProficiency with Stream Sets for orchestration, scheduling, and automation of data pipelinesAdvanced knowledge of Snowflake, including development of stored procedures, custom logic, and incremental load strategiesExperience with Netezza data structures and ability to map, transform, and migrate to SnowflakeExperience performing data profiling, cleansing, and validation to ensure accuracy and integrityProven ability to monitor production data loads and maintain performance during migration activitiesStrong troubleshooting and problem-solving skills to resolve migration issues effectivelyFamiliarity with data quality frameworks and post-migration validation processesDetailed Job Description:This role supports the Enterprise Data Warehouse (EDW) Migration Program from Netezza to Snowflake. The Senior Developer will be responsible for designing and building data synchronization scripts to manage both historical and incremental data migration from Netezza to Snowflake. A framework for this data synchronization exists already but the candidate will be responsible to move the data and resolve issues in doing so. The ideal candidate will have strong experience in Python/Jython scripting, Stream Sets orchestration, and Snowflake stored procedures.

Key Responsibilities:Analyze legacy Netezza data structures and develop mapping strategies to Snowflake.Create, test, and deploy Python/Jython scripts for extracting and syncing data from Netezza to Snowflake.Develop, test, orchestrate, and schedule Stream Sets jobs to execute data sync scripts.Conduct data profiling, cleansing, and quality checks to ensure data integrity and completeness.Create and maintain custom Snowflake stored procedures for data extraction using custom logic, including checksum calculations for incremental loads.Create, modify, maintain, and deploy Stream Sets manifests for data sync activities.Monitor Netezza production loads to ensure no disruption during data extraction.Provide proactive suggestions and assistance in identifying and resolving potential issues.Update and manage scheduling timelines for Stream Sets jobs.Ensure optimal balancing of data pulls from Netezza to avoid performance impacts.Execute post-migration data validation to confirm successful and accurate data transfer.