Azure Data Engineer/DeveloperThe Data Engineer job requires a variety of skills to be effective in this role.Data Modeler - Design & Create Transactional Database ModelsThe data engineer has primary responsibility for the development of all transactional, relational database models. This includes understanding both business and application requirements, then translating those requirements into logical and physical data models. Understanding basic data modeling concepts is required.Requires extensive experience with Msft/Azure SQL Server and CosmosDB NoSql databasesExperience in the Azure Cloud EnvironmentOur data solutions are built within an Azure Cloud environment.
As such applicants would need to be familiar with basic concepts within the Azure Cloud Environment.Azure Data Related Tools & ConceptsAzure StorageAzure SQL databasesAzure Data Lake Solutions and StrategyBig Data Architecture Concepts (HDFS, Hive)Azure CosmosDB Nosql SolutionsAzure Data FactoryAzure DatabricksAzure Data Factory and Databricks Development (Azure’s ETL Solution)All data landing solutions are created leveraging Azure Data Factory and Databricks. As such, applicants will need to be familiar with building ADF pipelines in order to read data, transform data, and write data to various locations.ADF related skillsAzure Data Factory PipelinesAzure Databricks NotebooksDatabricks Clusters and SparkScala or Python programming experienceSQL DevelopmentThe Data Engineer role spends much of their time analyzing data across our platform. Since our databases are generally created as Azure SQL databases, experience using sql is required.SQL Developer SkillsExperience with SSMSAbility to write complex sql queriesAbility to write DDL and DMLAbility to write Stored ProceduresNOTE: Databricks is mentioned in this write up several times, but I am trying to move away from that technology in the long run.