Unknown Company

Senior Staff Engineer, Data (657692)

santa clara, ca • Posted 1 weeks ago
Onsite Full Time General

Senior Data EngineerWe are looking for an experienced senior data engineer with software engineering skills to help us build critical data pipelines at massive scale, architect and build our big data warehouse and data mart systems, and develop models to facilitate real-time or near real-time applications, faster operational and historical analytics.Responsibilities:Participate in the full development life cycle of Data Warehouse and Data Mart systemsDesign and implement ETL frameworks for Data Warehouse system using technologies like Hive, Spark and JavaDesign, build and launch scalable, extremely efficient and reliable data pipelines to move data (both large and small amounts from diverse sources) into and out of Data Warehouse and Data Mart systemsDesign and implement data warehouse query engine, implement our proprietary cutting edge Hadoop-based data warehouse systemsGather and document data mart reporting and other requirements to meet business needsDefine and promote best practices and design principles for data warehousing techniques and architecture, while improving data organization and accuracy processing through data governance frameworkMonitor and troubleshoot performance issues on data warehouse and data mart serversDesired Skills & Experience:5+ years working experience in data warehouse development and architecture.4+ years of experience in Big Data, Data Warehouse or Large Scale Cloud systems5+ years ETL development/operations/reporting from multiple sources, using appropriate tools5+ years advanced SQL skills, including stored procedures, functions, indexes, and viewsA track record of crafting, implementing and delivering scalable, performant data pipelines and data servicesExpert level software development experience using Java and/or PythonExpertise with dimensional warehouse data models (star, snowflake schemas)Deep knowledge and hands-on experience with relational databases (Greenplum and Oracle, MySQL/Postgres etc) and database schema designExtensive experience with Hadoop, MapReduce/Yarn, Hive and HBaseKnowledge of automation and orchestration platforms such as AirflowBS/MS Degree in Computer Science or related fieldExcellent inter-personal and teamwork skills, having experiences working with oversea teams is a plus

Back to Job Search