Sr. Big Data Engineer (Framework CoE)This role supports Client's Wealth Management's Framework CoE team (Data Platforms Governance). You'll split time between:50% supporting existing Hadoop production (hands-on)50% building/enhancing frameworks for Hadoop ?
Snowflake migration (understanding existing frameworks + modernization)The team needs someone with a strong sense of ownership who can automate processes, build utilities, code, review code, test frameworks, and contribute to architecture/design.MUST-HAVE Skills (Non-Negotiable)Hadoop / Big Data experienceHands-on Apache SparkStrong UNIX + Python & Shell scriptingStrong hands-on SQL (querying + optimization)Working knowledge of GitHub, DevOps, and CI/CD pipelinesImportant: Candidate resume must clearly show how they used Hadoop/Spark/Unix/Python/SQL + CI/CD (projects, environment, impact).NICE-to-Have7+ years of experienceSnowflake and/or AWS exposureIDMC (Informatica Cloud) or any ETL/Data Integration toolFinancial Services experience (highly desirable)Key ResponsibilitiesDesign & develop new automation framework for ETL processingSupport the existing framework; become technical POC for related teamsEnhance ETL automation framework based on requirementsPerformance tuning for Spark and Snowflake ETL jobsRun POCs and suitability analysis for cloud migrationProcess optimization through automation + utility developmentPartner with teams on issues and new featuresSupport batch issues and application team queriesRequired Skills7+ years data engineering experienceStrong in UNIX Shell + Python scriptingStrong in SparkStrong SQLHands-on knowledge: HDFS / Hive / Impala / SparkLogical reasoning + problem-solving mindsetFamiliar with GitHub, DevOps, CI/CD / enterprise code management toolsStrong communication + collaborationSelf-driven; able to prioritize and resolve issues with minimal supervisionGood to have: Snowflake + any integration tool (ex: Informatica Cloud)Primary SkillsPython | Big Data | Apache SparkDesired SkillsSnowflake / Azure / AWS (any cloud)IDMC / any ETL tool