Senior Big Data EngineerWe are launching exciting products such as our new Wireless Headphone and WIFI Speakers that are Connected to the Cloud. Come be part of a new team focused on driving business value from the insights gained from these Connected Products!We are looking for a Senior Big Data Engineer to join our Big Data Analytics Platform team. In this role, you will be responsible for designing, developing, deploying and supporting the data ingestion pipeline from our Connected Products.
In this role, you will be partnering with our data science community by supplying highly performant data sets for advanced analytics and will provide leadership and experience in the data engineering space.The candidate must be results driven, customer focused, technologically savvy, and skilled at working in an agile development environment.Job ResponsibilitiesDesign and develop the data ingestion pipelines into the Big Data & Analytics Platform for a variety of big data use casesDeploy and support highly optimized solutions with a focus on automationParticipate in the end to end delivery of business use-cases including data architecture to deliver resultsDeliver as part of an agile scrum team on the highest business value use cases that will drive our business strategyPartner with IT architects to define analytic architecture that best leverages the Big Data Platform to enable advanced analytics capabilitiesProvide leadership to the ongoing maturity of the development process, coach/mentor the development team on best practices and methodologies for enhanced solution developmentStay up to date on the relevant technologies, plug into user groups, understand trends and opportunitiesRequired Demonstrable SkillsDeep expertise is working with data – all kinds, clean, dirty, unstructured, semi-structuredHave strong expertise Apache Spark (batch and Spark streaming)Experience in real-time and batch data processing and associated technologiesAble to demonstrate strong skills in programming/scripting languages such as Python, Scala, Java and RAbility do design, develop and deploy end to end data pipelines that meet business requirements and use casesExperience with all Cloudera components with focus on Impala, Hive, Hbase, Scoop and HueExperience with automation technologies such as OozieStrong experience with large cloud-compute infrastructure solutions such as Amazon Web Services, Google, AzureKnowledge of UNIX/LinuxExperience with Text AnalyticsStrong knowledge of SQLExperience in Hadoop Platform Security and Hadoop Data Governance topicsExperience in triaging production issues to understand and resolve the issueExperience in technical computing (optimization, statistics and machine learning)Experience with analytics visualization software such as TableauExperience leading development teams, defining development processes, evaluating new technologies and practices to enhance solution deliveryQualificationsMinimum of BS in Computer Science or similar field requiredMust have at least 5-8+ years' experience in information management and application developmentMust have a minimum of 3-5 years working hands on with Big Data technologies