Senior Data Engineer Overview
Are you ready to apply Make sure you understand all the responsibilities and tasks associated with this role before proceeding.
- The Senior Data Engineer designs and maintains enterprise data platforms, ensuring secure, scalable solutions for analytics, reporting, and AI initiatives.
- Collaborates with cross-functional teams to deliver data solutions aligned with organizational requirements and objectives.
- Develops robust data pipelines and transformation processes using modern cloud technologies and frameworks.
- Implements Medallion Architecture and enterprise data models to deliver high-quality data products.
- Optimizes data storage structures and integration frameworks for performance and cost efficiency.
- Ensures compliance with data governance, security, and privacy standards in partnership with relevant teams.
- Evaluates emerging cloud and analytics technologies to enhance data engineering capabilities.
- Monitors and optimizes data platform performance and operational processes.
Senior Data Engineer Key Responsibilities & Duties
- Design, build, and maintain Microsoft Fabric Lakehouse solutions and enterprise data platforms.
- Develop scalable data ingestion, transformation, and orchestration processes supporting analytics and AI initiatives.
- Implement Medallion Architecture and Delta Lake standards for trusted data products.
- Optimize Lakehouse storage structures and integration frameworks for reliability and scalability.
- Collaborate with business and technical teams to align solutions with organizational needs.
- Ensure adherence to data governance, security, and quality standards.
- Follow SDLC, DevOps, CI/CD, and best practices in data engineering.
- Troubleshoot and optimize data platform performance and reliability.
Senior Data Engineer Job Requirements
- Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
- 5-7 years of experience in enterprise data engineering solutions using Microsoft Fabric, Azure Data Factory, or similar platforms.
- Strong understanding of data integration, ETL/ELT, Lakehouse architecture, and cloud data platforms.
- Proficiency in SQL/T-SQL, Python, REST APIs, and automation technologies.
- Experience with Delta Lake, Parquet, data governance, and metadata management.
- Familiarity with Git, CI/CD, DevOps processes, and Infrastructure-as-Code concepts.
- Strong communication and collaboration skills for partnering with stakeholders. xhqgsiq
- Legal industry experience preferred but not required.
Senior Data Engineer in new york at Unknown Company
This position is listed as full time and onsite.