Principal Data Engineer

Responsibilities

• Be a strong technical person on our team who helps drive innovation
• Be responsible for producing and maintaining critical data deliverables / pipelines
• Be technically talented, able to contribute quality code
• Be responsible for the quality, scope, and timeliness of all your deliverables

Requirements

• Degree in computer science, a related field, or equivalent work experience (10+ years)
• Strong communication and collaboration skills (both written and verbal)
• Experience using AI to enhance the full data life cycle
• Proven track record at using technology to automate data processes
• Strong SQL skills, including Jinja templating / DBT
• Experience with Snowflake and Airflow (Astronomer)
• Experience in environment using dbt and Snowflake
• Experience with Python including exposure to data science packages (NumPy, Pandas, scikit-learn)
• Experience manipulating, processing and extracting value from large, disconnected datasets (Spark)
• An understanding of AWS Cloud technologies and how to create scalable applications
• Exposure to and interest in the following technologies: AWS Serverless and serverless-supported languages
• SQL and/or NoSQL experience (ex, MySql, Cassandra, DynamoDB, Snowflake)
• Streaming technologies (Amazon Kinesis, Kafka)
• Message Queues (SQS, RabbitMQ, ActiveMQ)
• Comfort working within an agile development cycle and exposure to: Linux development
• Git and versioning software
• Build systems (Maven, SBT, Gradle, etc) and common build patterns
• Experience automating data flows and reporting in a regulated environment a plus

Core Competencies

Demonstrates expertise in SQL, Python, and data pipeline automation, with a strong focus on leveraging AI to enhance data processes. Proven ability to manage large datasets and deliver high-quality, timely data solutions in a collaborative environment.