Hadoop & Talend Senior ArchitectNumber of Openings: 1Duration of Hiring: Sep 2021 – Jun 2022No of years' experience: 10+Skill Set:Expertise in Hadoop Data Lake Architecture – Raw, transformed, semantic layers creation.Expertise in Hive – creating external tables, loading file data, Hive queries for transformations, UDF'sExpertise in Spark (PySpark) – Spark SQL, Data frames, Joins, UDF's, Job scheduling, configurations (executors and memory), Monitoring.Expertise in Talend ETL – Reusable Jobs, File processing, Connecting to RDBMS Sources, Connecting to Hive/Impala, Audit Jobs, Calling Spark Jobs, Talend cloud 7.3.Design, Architecture and implement effective Analytics solutions and models using Hadoop/Impala.Design, Architecture and implement effective Analytics solutions using Power BI and Hive/Impala.Examine and identify Datawarehouse structural necessities by evaluating business requirements.Assess Datawarehouse implementation procedures to ensure they comply with internal and external regulations.Prepare accurate Datawarehouse design and architecture reports for management and executive teams.Monitor the system performance by performing regular tests, troubleshooting and integrating new features.Recommend solutions to improve new and existing Datawarehouse solutions.Educate staff members through training and individual support.Offer support by responding to system problems in a timely manner.Understand and document data flows in and between different systems/applicationsGuidance to developers in preparing functional/technical specs to define reporting requirement and ETL process.Technical Skills:Cloudera (CDH) HadoopHivePySparkImpalaTalend 7.1, 7.3Data ModelingFramework build on Ingestion, Audit, Logging and ReconciliationDevOpsWork Location: Rosemead, California
Hadoop & Talend Senior Architect in rosemead at Unknown Company
This position is listed as full time and onsite.