Senior Data EngineerApex Systems is seeking a strong Senior Data Engineer with 7+ years of experience and that will lead projects and provide technical expertise for research, development and modification of extract, transform, load processes and jobs in support of a Big Data infrastructure to lead the implementation and support of the enterprise AWS Cloud environment, with emphasis in EMR and Redshift.Location: RemoteEstimated Duration: 6 months with high likelihood to convert to Full time in the first quarter of 2023Compensation: Competitive, Depending upon experienceTeam/ EnvironmentThe team is looking for a self-starting, individual for the Data & Analytics Hub Team –that work in squads and have various data roles (engineers, scientist, etc.) & business partners. They will do some data science, data engineering, and data strategy in this team and all report up through the data office team. They will manage all data types for the company including Fuel data, retail data, store data, hedging & trading, loyalty & guest data, etc.
The team will consist of 4-6 other data engineers that you will mentor.Must have skills/certs/technologies:AWS RedShift as well as hands-on experience in S3 storage, orchestration of data,PySparkSnowflake Schema Generic SQL (Use PostgreSQL OR SQL Server)Preferred qualifications:AWS DataBricksGitHub (actively working within)Mentorship/Lead experienceJIRAAI/ML experience (partner w/ these teams)Education or Certification Requirements:AWS Solutions Engineer OR Architect preferredThis is an exciting opportunity. If interested, please apply directly to this posting with a word.doc copy of your resume.Project Details – Size, Scale, Scope?Data & Analytics Hub Team – work in squads that have various data roles (engineers, scientist, etc.) & business partners -- do some data science, data engineering, and data strategy in this team and all report up through the data office teamDay to Day Responsibilities/typical day look like:Understanding how to optimize and organize data (make it more intuitive too versus just easy to access)Understand orchestration of data – work with RDMS but also do work with some unstructured data and have to transform to tables etc.Coaching/mentorship/strategy (40-50% or so of their work will be more focused on this area)Project overview meetings w/ managerOverseeing and doing code reviews on data engineering workNeed to have strong communication skillsHelp give opinions on the architecture (but will be focused on data engineering work)What are the top must-have technologies/required experience for the position?AWS RedShift as well as hands-on experience in S3 storage, orchestration of data,PySparkSnowflake SchemaGeneric SQL (Use PostgresSQL OR SQL Server)Preferred qualifications:AWS DataBricksGitHub (actively working within)Mentorship/Lead experienceJIRAAI/ML experience (partner w/ these teams)Level of experience target (junior/mid/senior and/or years of experience): Senior, 7+ years of experience and at least a couple years in AWS (Redshift, etc.