Azure Data Engineer @ RemoteTech Stack: Azure Cloud Azure Data Factory Azure Synapse Azure Databricks Azure Key Vault Azure Functions. CI/CD: Terraform, Azure Dev OPS Build Pipelines Experience Cloud Data Modeling – Designing/Building Canonical Models Scope: Design/Buildout Silver and Gold Layer of our Modern Data Platform. Currently need is for batch processing.
Real-time processing in the next few months. We are looking for a Senior Data Engineering to assist with designing and building out silver/gold layer. This would include both a full refresh and incremental/delta refresh.
Currently we have data from multiple data sources ingested into our bronze layer. We want to further refine/curate this data into the gold layer.