Senior Data Engineer

Senior Data Engineer

We are looking for an experienced Data Engineer to join a dynamic data engineering team and contribute to the development of modern, scalable data solutions within a Microsoft Azure and Databricks environment.

You will play a key role in designing, developing and maintaining data pipelines and data platforms, working with large and complex datasets to support business intelligence, analytics and data-driven decision-making.

This is an excellent opportunity for a Data Engineer who enjoys working with modern cloud technologies and is interested in data architecture, modelling and building robust data solutions.

Key Responsibilities

• Design, develop and maintain scalable data pipelines and ETL/ELT processes using Azure Data Factory (ADF) and Azure Databricks.
• Develop efficient data processing and transformation solutions using Python and Databricks.
• Work with large and complex datasets, ensuring data quality, reliability and performance.
• Contribute to the design and implementation of modern data architectures within the Azure ecosystem.
• Work with Medallion Architecture principles to build robust and scalable data solutions.
• Support the development of Data Vault and Business Vault architectures using Databricks on Azure.
• Work with Microsoft Fabric and OneLake, including the use of shortcuts to integrate and access data across different platforms.
• Contribute to data modelling activities within Azure Data Warehouse and related analytical environments.
• Collaborate with Data Architects, Developers, Analysts and other stakeholders to understand requirements and translate them into effective technical solutions.
• Identify opportunities to improve data processing, architecture, performance and automation.
• Ensure solutions follow best practices around scalability, security, maintainability and data governance.

Requirements

• Proven professional experience as a Data Engineer.
• Strong hands-on experience with Azure Data Factory (ADF).
• Strong experience with Azure Databricks.
• Good programming skills in Python.
• Solid understanding of data engineering principles, including ETL/ELT, data transformation and data modelling.
• Experience working with cloud-based data platforms and large-scale data processing.
• Good understanding of SQL and relational data concepts.

Nice to Have

• Experience with Medallion Architecture.
• Knowledge of Data Vault / Business Vault methodologies.
• Experience implementing Data Vault solutions using Databricks on Azure.
• Experience with Microsoft Fabric and OneLake, particularly OneLake shortcuts.
• Knowledge of data modelling in Azure Data Warehouse.
• Experience working within the financial services or wealth management sector.
• Familiarity with data governance, data quality and modern cloud data architecture principles.

What do we offer you?

• Remote within Spain Time zone.
• Possibility to be part of a multicultural team and work on international projects.
• CET working hours

Talan Spain's commitment to non-discrimination based on gender, race, ideology, or any other reason, in accordance with the company's "Equality Plan" and the current regulations on gender equality between women and men (Royal Decree-Law 6/2019).