Data EngineerThis position will focus on developing various database and data loading/transformation efforts. Initiatives could include multiple source files and/or files sourced both internally and externally. Candidate is required to interact with databases using AWS Lambda, AWS Glue (for transformations) Python and Spark.
Possible work leveraging SnapLogic for ETL, depending upon use case. Work will be applicable to multiple applications. Knowledge of automated testing of data a plus.Responsibilities:Design and built data applications for analytical reportingAnalyze data and design ETL frameworks using Python and Spark technologiesCollaborate with business partners to gather requirements and translate that to technical specificationsAdhere to lean agile methodologiesProduction Support including root cause analysis and long term fixesImplement data pipelines to meet business requirements and adhere to best practicesRequired Skills:Proficient in Python, Spark and database technologiesExperience with various AWS services like AWS Glue, IAM, RDS, S3, SQS, SNS, Lambdas, Cloud Formation, AWS Glue, Cloud Watch, Event Bridge, CLIExperience with Unix/LinuxExperience with SQLExperience with source code control, preferably Git