Unknown Company

Principal Data Engineer (Azure, Databricks, Big Data) | TELECOMMUTE

Remote • Posted 2 weeks ago
Onsite Full Time Computer and Mathematical Occupations
Job Title

100% telecommute. Potential for very limited travel.

Work hours: 8-4 PST

Interview Process: 2 rounds. 1st being of a technical nature and the second will be geared towards work practice and general work experience and scenario based questions.

Project: The project is the Heartbeat Pharmacy analytics cloud application, we are working on expanding out the application to be fully production ready and to bring in more data, real-time analytics and alerting.

Team: The team consists of 2 developers, and a SQL engineer, currently.

Responsibilities:

  • Create and maintain data jobs in Azure cloud environment, CI/CD pipelines for azure development and deployment, Databricks delta tables, live tables, and general databricks infrastructure.
  • Build data pipelines for production pharmacy data to cloud according to business need.
  • Develop CI/CD pipelines and maintain for application development and production readiness.
  • Build medallion layered datasets in databricks and maintain for use in operation applications.

Ideal Background: Cloud engineering with Azure experience, experience with datafactory, databricks, and overall cloud infrastructure and security.

Required:

  • At least 5 years of data engineering in Azure cloud.
  • Experience building and maintaining pipelines in datafactory.
  • Experience building CI/CD strategy utilizing Jenkins, GIT, Terraform. 5 years of experience working with big data warehouse solutions in the cloud.
  • Hadoop/Hive, Synapse, Databricks. 3 Years’ experience specifically with Databricks.

Principal Data Engineer (Azure, Databricks, Big Data) | TELECOMMUTE in Remote at Unknown Company

This position is listed as full time and onsite.

Back to Job Search