Azure Data Engineer

NSD International, Inc. is hiring an Azure Data Engineer for contract work supporting an Azure-based data platform.

Responsibilities

• Support the active development of an Azure data platform in close coordination with the team
• Begin with establishing a reference data system for securities and pricing data , then expand to additional data domains
• Follow internal development standards to contribute to the overall Data Strategy agenda
• Implement Azure Cloud Platform solutions and apply relevant know-how across the qualifications listed below

Requirements

• 10+ years of software development experience using Python and PySpark and associated frameworks
• Proven background as a Data Engineer and/or Data Quality Engineer with Azure cloud experience
• Experience implementing solutions with Azure cloud services
• Hands-on experience implementing Azure Data Factory
• Hands-on experience implementing Azure Lake Gen 2
• Hands-on experience implementing Azure Databases
• Hands-on experience implementing Azure Databricks
• Experience implementing a Data Quality Framework/Solution
• Experience implementing Collibra Data Quality or other data quality tools including IDQ , IBM , or Ab-Initio
• Experience implementing Collibra Data Governance with knowledge of data lineage
• Experience implementing Power BI
• Well versed with Azure Databricks
• Strong SQL skills with RDMs or noSQL databases
• Familiarity with the DevOps lifecycle including git and Jenkins
• Experience with CI/CD processes
• Good understanding of ETL/ELT processes
• Financial services industry experience is a plus, including financial instruments, asset classes, and market data

Key Technologies

• Python, PySpark
• Azure cloud services
• Azure Data Factory
• Azure Lake Gen 2
• Azure Databases
• Azure Databricks
• Data Quality Framework/Solution
• Collibra Data Quality, IDQ, IBM, Ab-Initio
• Collibra Data Governance, data lineage
• Power BI
• SQL, RDMs, noSQL
• DevOps lifecycle: git, Jenkins, CI/CD processes
• ETL, ELT

Benefits

• 401(k) matching
• Dental insurance
• Health insurance
• Vision insurance

Contract Details

• Job type: contract
• Term: 1 year (possibility of extension)
• Pay: $74.00 per hour
• Expected hours: 35.0 – 45.0 per week
• Work location: Hybrid remote in Charlotte, NC 28202