Data Engineer

Senior Data Engineer

Newport Beach, CA (remote)

Projected duration: 3-6+ month contract (potential for extension)

Key Responsibilities:

• Design, develop and maintain scalable data pipelines
• Develop data ingestion and integrations (REST, SOAP, SFTP, MQ, etc.) processes
• Take ownership of building data pipelines
• Actively engage in technology discovery and implementation for both on-prem and in Cloud (i.e. Azure or AWS) to build solution for future systems
• Develop high performance scripts in SQL/Python/etc. to achieve objectives of enterprise data, BI and analytics need.
• Incorporate standards and best practices into engineering solutions
• Manage code versions in source control and coordinate changes across team
• Participate in architecture design and discussions
• Provide logical and physical data design, and database modeling
• Be part of the Agile team to collaborate and to help shape requirements
• Solve complex data issues around data integration, unusable data elements, unstructured data sets, and other data processing incidents
• Supports the development and design of the internal data integration framework
• Works with system owners to resolve source data issues and refine transformation rules
• Partner with enterprise teams, data scientist, architects to define requirements and solution

Key Qualifications :

• Have a B.A./B.S. and 5-8+ years of relevant work experience; or an equivalent in education and experience
• Must have excellent experience with Snowflake
• Hands on experience with Microsoft Stack – SSIS, SQL, etc.
• Possess strong analytical skills with the ability to analyze raw data, draw conclusions, and develop actionable recommendations
• Experience with the Agile development process preferred
• Proven track-record of excellence and consistently delivered past project successfully
• Hands on experience with Azure data factory V2, Azure Databricks, SQLDW or Snowflake, Azure analysis services and Cosmos DB
• Experience with Python or Scala.