Unknown Company

Data Engineer (Openshift)

washington, dc • Posted 3 days ago
Onsite Full Time General

Data EngineerExperience: 8+ YOE For Mexico please consider only Mexican Citizens. Job Summary: We are seeking a skilled Data Engineer with expertise in OpenShift to design, build, and maintain scalable data pipelines and data lakes. The ideal candidate will have hands-on experience with Python, PySpark, SQL, Snowflake, and Data Factory, and will play a key role in transforming raw data into meaningful insights for our organization.Key Responsibilities:Develop, deploy, and manage data pipelines using Python, PySpark, and Data Factory.Design and optimize data lakes and data warehouse solutions, particularly leveraging Snowflake.Build and maintain scalable ETL/ELT processes for large datasets.Collaborate with data scientists, analysts, and stakeholders to understand data requirements.Ensure data quality, integrity, and security across all data systems.Manage deployment and orchestration of data workloads on OpenShift container platform.Automate data workflows and improve data processing efficiency through scripting and orchestration tools.Monitor system performance and troubleshoot issues related to data pipelines and infrastructure.Required Skills & Qualifications:Bachelor’s degree in Computer Science, Data Science, or related field.Proven experience with Python programming for data engineering tasks.Hands-on experience with PySpark and SQL for data transformations.Strong knowledge of Snowflake data platform.Experience with cloud data tools such as Data Factory or equivalent.Familiarity with Data Lakes architecture and best practices.Solid understanding of containerization and orchestration using OpenShift.Familiarity with DevOps principles, CI/CD pipelines, and automation.Strong problem-solving and communication skills.

Back to Job Search