Skillset Data Engineer5-8 years exp.
Responsibilities:Analyze and understand existing Tidal job dependencies, schedules, and scripts.Develop shell scripts and Python-based workflows to replicate and enhance current Tidal processes in Airflow.Write and optimize SQL queries for Snowflake-based data transformations and validations.Collaborate with cross-functional teams to ensure data pipelines are robust, scalable, and well-documented.Work with AWS S3 for data ingestion and storage processes.Ensure high reliability and performance of data pipelines post-migration.Provide support during testing and post-migration validation.Required Skills:Shell scripting – strong experience requiredPython – strong experience requiredSQL – strong experience required, preferably with SnowflakeAWS S3 – hands-on experienceSolid Data Warehouse background and understanding of ETL/ELT best practicesPreferred Skills (Nice to Have):Experience with Apache AirflowPrior experience with scheduling tool migrations, especially TidalFamiliarity with CI/CD practices and DevOps for data pipelines