AWS Data Engineer

Senior AWS Cloud Data EngineerSkills: AWS, data engineer, AWS Glue, data lake, etc Must be local to NJ Must have at least 10 years of experienceJob RequirementsDatabricks, delta lake, AWS building data pipelines and data processing solutions based on AWS platform, & PythonMust have Data Bricks, AWS, Python or PySpark development experienceStrong experience in relational and non-relational data architectureStrong experience in data classification based on data typeStrong experience in working with Data Scientists, Architects, and business experts to clarify requirements for components and features of the Data Lake. Ability to garner requirements for varying consumers of Data Lake is strongly desiredStrong expertise in designing, and developing metadata-driven Data Lake solutions for ingesting historic and near real-time structured/semi-structured/unstructured data10 years or more experience in data managementMinimum 2 years of experience managing changes in enterprise-grade operational Data LakeHands-on experience developing systems that leverage multiple AWS services including CloudFormation, Lambda, API Gateway, S3, DynamoDB/ any NoSQL, Relational Database Service (RDS), Glue Catalog, Crawler, Glue ETL job, Athena and QuickSight for data management and analysisStrong experience in design & implement ETL and ELT pipelines is a mustExperience in AWS EMR is plusExpertise in using tools like Gliffy to create diagrams representing Business Process, ERD and AWS Architecture is a PLUSExperience in developing solutions for data Ingestion, Transformation, Cataloging, In-Place Querying, Storage, and Security using AWS tools and best practicesExperience in Relational/NOSQL database into an Enterprise Data Lake is a PlusExperience in setting up AWS CloudWatch, CloudTrail for monitoring and Optimizing the Data Lake environments is a PLUSProficient in Python, PySpark, AWS Glue ETL jobsSQL queries using AWS Athena and mapping of various relational DB queries to AthenaExperience in de-normalizing/flattening data structures in Parquet/ORC is nice to haveGood understanding of AWS IAM policies to implement security best practices in DataLakeFollow and enforce strict standards for code quality, automated testing, infrastructure-as-code and code maintainabilityRobust debugging skills and knowledge of automated testing platforms and unit testsAbility to work in an agile collaborative environment, take lead on developing Stories and translating requirements to Problem StatementExperience using Agile collaboration tools like Jira, ConfluenceStrong analytical skills, problem solving aptitude and strong presentation/communications skillsAWS Certification plus