Job TitleSan Jose, CA/PST Zone Duration: 1 year # of Positions: 2ResponsibilitiesDesigning, developing & tuning data products, applications and integrations on large scale data platforms (Hadoop, Kafka Streaming, Hana, SQL server etc) with an emphasis on performance, reliability and scalability and most of all quality.Analyze the business needs, profile large data sets and build custom data models and applications to drive business decision making and customers experience.Develop and extend design patterns, processes, standards, frameworks and reusable components for various data engineering functions/areas.Collaborate with key stakeholders including business team, engineering leads, architects, BSA's & program managers.SkillsMS/BS in Computer Science / related technical field with 4+ years of strong hands-on experience in enterprise data warehousing / big data implementations & complex data solutions and frameworksStrong SQL, ETL, scripting and or programming skills with a preference towards Python, Java, Scala, shell scriptingDemonstrated ability to clearly form and communicate ideas to both technical and non-technical audiences.Strong problem-solving skills with an ability to isolate, deconstruct and resolve complex data / engineering challengesResults driven with attention to detail, strong sense of ownership, and a commitment to up-leveling the broader IDS engineering team through mentoring, innovation and thought leadershipDesired SkillsFamiliarity with streaming applicationsExperience in development methodologies like Agile / ScrumStrong Experience with Hadoop ETL/ Data Ingestion: Sqoop, Flume, Hive, Spark, HbaseStrong experience on SQL and PLSQLNice to have experience in Real Time Data Ingestion using Kafka, Storm, Spark or Complex Event ProcessingExperience in Hadoop Data Consumption and Other Components: Hive, Hue HBase, Spark, Pig, Impala, Presto