OCIO is seeking a Mid-Level Data Engineer to design, build, and manage data pipelines and systems that enable enterprise analytics and decision-making. This role involves developing ETL workflows, writing Python scripts, and leveraging AWS and Azure cloud services while ensuring compliance with industry standards for security, scalability, and data governance. The Application Programmer will work with Snowflake, data warehousing, data marts, and visualization tools like Power BI and Tableau.
Duties and Responsibilities
- Design and implement data pipelines to support analytics and reporting.
- Develop and maintain ETL/ELT workflows using AWS Glue, Azure Data Factory, and Snowflake Tasks.
- Build and optimize data pipelines using Python, PySpark, and SQL.
- Work with solution architects to define and maintain data models for data warehouses and data marts.
- Optimize and tune workflows for performance and scalability.
- Perform data profiling, quality checks, and implement Change Data Capture (CDC) and AWS DMS.
- Collaborate with stakeholders to define data requirements and deliver solutions.
- Enable reporting and dashboards using Power BI and Tableau.
- Apply data governance, security, and compliance standards (ISO 27001, SOC 2, GDPR/CCPA).
Required Qualifications
- Bachelor’s degree in computer science, Engineering, or related field.
- 3–5 years of experience in data engineering or data management.
- Proficiency in SQL and experience with data modeling.
- Hands‑on experience with AWS and Azure cloud platforms (AWS experience preferred).
- Experience with Snowflake and Oracle for data warehousing and data marts.
- Strong problem‑solving and debugging skills.
- 1–2 years of experience with Power BI/Tableau (deployment pipelines, direct query vs dataflows).
Desired Skills
- Experience with ETL tools (AWS Glue, Azure Data Factory, Talend).
- Knowledge of data warehousing concepts, data quality analysis, and profiling.
- Exposure to CI/CD pipelines (GitHub Actions, Jenkins) and infrastructure automation (Terraform, CloudFormation).