Azure Data EngineerLocation: Raleigh, NC (5 Days Work from office) Duration: 12+ months Rate: DOEExpert level skills writing and optimizing complex SQLExperience with complex data modelling, ETL design, and using large databases in a business environmentExperience with building data pipelines and applications to stream and process datasets at low latenciesFluent with Big Data technologies like Spark, Kafka and HiveExpert level understanding on Azure Data Factory, Azure Synapse, Azure SQL, Azure Data Lake, and Azure App Service is requiredDesigning and building of data pipelines using API ingestion and Streaming ingestion methodsKnowledge of Dev-Ops processes (including CI/CD) and Infrastructure as code is essentialExperience in developing NO SQL solutions using Azure Cosmos DB is essentialWorking knowledge of Python is desirableDesigning and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure servicesManaging and optimizing data storage using Azure Data Lake Storage, Azure SQL Data Warehouse, and Azure Cosmos DBImplementing data security measures, including encryption, access controls, and auditing, to protect sensitive informationAutomating data pipelines and workflows to streamline data ingestion, processing, and distribution tasksUtilizing Azure's analytics services, such as Azure Synapse Analytics, to provide insights and support data-driven decision-making.