Data Engineer (Skillbridge Intern) - 28499

Data Engineer (Skillbridge Intern)This is an UNPAID internship through the DoD SkillBridge Program for transitioning active-duty US military personnel. The intern will actively train on meaningful projects and work closely with a mentor and with senior company leadership.Essential Job Responsibilities:The SkillBridge intern will train as a Data Engineer with Enlighten, reporting to a designated Enlighten Supervisor, with the goal of learning Enlighten's Enterprise approach to design, build, and optimize Big Data Platform (BDP) systems for data collection, storage, access, and analytics at scale.The intern will be assigned special projects as needed.Desired End State (3-4 month target): At the end of four months, the intern will be able to understand basic data engineer concepts. Data engineers, as part of enterprise data analytics teams, manage, optimize, oversee, and monitor data retrieval, storage, and distribution throughout the BDP enclaves.

The intern will develop a good understanding of all critical tasks to successfully conduct data engineer objectives:Data acquisitionDevelop data set processes (Extract, transform, load (ETL))Use programming language and toolsIdentify ways to improve data reliability, efficiency, and qualityPrepare data for predictive and prescriptive modelingUse data to discover tasks that can be automatedTraining Plan:Phase 1 BasicsWeek 1: In processing, Introductions/office familiarizationWeek 2: Intro to the Big Data Platform (BDP) technologiesWeek 3: Intro to BDP analytics and applicationsWeek 4: Intro to Army and Air Force Cyber data ETL processPhase 2 Parser OverviewWeek 5: Data Acquisition, Taxonomy/SchemaWeek 6: Review existing parsers and deployment flows; understand existing transforms available for use in parsers.Weeks 7-8: BDP technologies - Kafka and Nifi workflows; Establish a development environment for BDP parser developmentPhase 3 Parser Development, Deployment, and TestingWeeks 9-11: Modify Kafka and Nifi workflows; modify existing parser schema and transforms to alter ingest pipeline.Weeks 12-13: Understand how to access logs to identify errors; understand common parser development errors; troubleshoot errors.Additional Goals:Project managementMinimum Qualifications:Active-Duty Military ONLY within final 180 days of active-duty service.Minimum of 5 years relevant experience with Bachelors in related field; 3 years relevant experience with Masters in related field; or High School Diploma or equivalent and 9 years relevant experience.Additional experience dependent on Program of Instruction.Physical Requirements will vary and is dependent on the Program of Instruction.