Data Engineer - #2174981

Data Engineer

Up to £65,000

An exciting opportunity has arisen for a Data Engineer to join an organisation undertaking a significant transformation of its data and analytics landscape.

As a Data Engineer, you will play a key role in designing and building the foundations of a scalable, cloud-based data estate. Working within a growing data function, you will help develop the pipelines, frameworks and governance capabilities needed to deliver data across the business.

This position offers the opportunity to work with modern technologies including Azure Databricks, contributing to both the migration programme and the long-term evolution of the data platform. You will be involved in everything from designing robust data solutions and engineering high-quality datasets through to establishing best practices and improving platform performance.

For engineers who enjoy solving complex data challenges, building modern data platforms and driving meaningful change through technology, this role offers the chance to make a genuine impact while working on a large-scale transformation programme.

Key Responsibilities

• Supporting the migration from a legacy SQL-based environment to Azure Databricks.
• Designing and developing scalable data solutions using Databricks, Python and PySpark.
• Building and maintaining robust data pipelines, transformation frameworks and curated data layers.
• Implementing governance, security and data management best practices through Unity Catalog.
• Optimising data models and datasets to support analytics, reporting and self-service BI requirements.
• Working with stakeholders to understand data needs and deliver trusted, accessible data products.
• Contributing to data architecture decisions and promoting modern engineering standards and best practices.

Skills & Experience

• Strong hands-on experience with Azure Databricks.
• Experience building data pipelines using Python and/or PySpark.
• Understanding of Delta Lake, lakehouse architectures and modern data platform design.
• Experience working with Unity Catalog for data governance and access management.
• Strong SQL development, optimisation and data modelling expertise.
• Experience working within Azure data environments and modern cloud-based data platforms.

What's On Offer?

• Up to £65,000 salary.
• Hybrid working model.
• Opportunity to play a key role in a large-scale Databricks migration programme.
• Ongoing professional development and certification support.
• Chance to influence the future direction of the organisation's data platform.

If you are looking to work with Azure Databricks at scale and be part of a major modernisation programme, this role offers the chance to develop your skills while making a tangible impact across the organisation.