Senior Data Engineer

Public Sector Resourcing • Contract • United Kingdom • 23h ago

Please be aware that this role can only be worked within the UK and not Overseas.

Note: SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position, (and speed at which we require a postholder in situ), preference may be given to candidates who meet all of the essential criteria and hold active security clearance

You’ll join the STG Performance Team, which is tackling a fundamental challenge across our Directorate General. We’re addressing this by developing two things: a modern, user-centred framework for measuring performance and organisational health, covering everything from delivery and finance to people, risk and user satisfaction, and a dashboard for senior leaders to surface these metrics and use them to inform collective decision-making.

We’ve already built an MVP dashboard in Amazon QuickSight, now in active use. We’re now rebuilding it using a flexible, code-first approach and using this team as a testbed for smarter digital delivery, applying product operating model principles, working in lean and cross-functional ways, and embedding AI-native workflows using tools like ChatGPT, GitHub Copilot and agentic assistants.

A key focus for this role will be strengthening our data foundations. That means reviewing and improving our existing pipelines, some of which are still manual, and replacing them with more modern, automated and consistent approaches using our Analytical Platform. We want to reduce the burden on teams to collect and share data, retrieve more from source, and drive better conversations about data quality, completeness and fitness for purpose. We see dashboards not just as reporting tools, but as a way to spark a virtuous cycle of improvement, showing the current state of data (even when it’s rough), surfacing what matters most, and helping leaders take informed action.

You’ll play a central role in that cycle. You’ll work closely with colleagues across performance, data, digital and portfolio teams to improve how we collect, structure and use data, and you’ll be an advocate for data that drives better decisions and more joined-up leadership across the group.

Skills and Experience

Strong experience designing, building and maintaining data pipelines using modern, cloud-based tools and practices
Proficiency in Python and SQL for data engineering tasks
Experience with dbt and a good understanding of data modelling approaches (e.g. star schema, dimensional modelling)
Familiarity with Airflow or similar orchestration tools
Comfortable working with AWS services such as Glue and S3, or equivalent cloud infrastructure
Experience using version control and CI/CD tools like Git and GitHub Actions
Confident working independently and taking ownership of problems and solutions
Comfortable engaging directly with stakeholders, both technical and non-technical, to understand needs, share ideas and shape solutions
Willingness to work closely with users, gather feedback, and iterate quickly to improve products and data quality
Adaptable, curious, and open to experimenting with new tools, techniques and ways of working, including AI coding assistants and lean, cross-functional approaches

Related Jobs

Executive Assistant

Barclays • Contract • Glasgow, Glasgow City, Scotland, United Kingdom • 14h ago

Inside IR35 6 months

Overall purpose of the role: We’re looking for a proven Executive Assistant within financial, corporate or legal industries that thrives on managing multiple, shifting priorities with confidence and precision. This is a...

14h ago

Apply

Adoption Software Engineer - Authorisation

Barclays • Contract • United Kingdom • 14h ago

Inside IR35 6 months

Location: Glasgow, London or Radbroke (Hybrid) Overall purpose of the role: We are seeking an Adoption Software Engineer to join Barclays working with a global-scale technology platform used by millions of users worldw...

14h ago

Apply

Assurance Specialist - Closure Validation

Barclays • Contract • Glasgow, Glasgow City, Scotland, United Kingdom • 14h ago

Inside IR35 Hybrid Working 6 months

Overall purpose of the role: As an Assurance Specialist, you will play a key part in validating the remediation of risks and control gaps identified across our global businesses. When a control issue is raised, our busin...

14h ago

Apply

Agile Delivery Lead

Barclays • Contract • London, Greater London, England, United Kingdom • 14h ago

Inside IR35 12 months

Overall purpose of the role Be at the Heart of Innovation! Join Barclays and play a pivotal role in revolutionizing how we understand and engage with our colleagues. We're looking for a dynamic Agile Delivery Lead to d...

14h ago

Apply

Application Support Engineer

Lorien • London, Greater London, England, United Kingdom • 21h ago

Inside IR35 6 months

Investment Banking - Business Area/Dept Overview The APS F2B Flow (Application Production Support - Front to Booking Flow) department is a global entity providing services to the FX, EQD, Rates and Credit businesses with...

21h ago

Apply

Senior Business Analyst

Huxley • London, Greater London, England, United Kingdom • £600 - £650 / day • 21h ago

Inside IR35 Umbrella Hybrid Working

I am currently supporting a London Markets Insurance Client who are looking for a Senior BA to join their team on an 18 Month piece of work supporting their Insurance Platform Replacement programme. You will be required...

21h ago

Apply

Cost Modeller

Public Sector Resourcing • Contract • Corsham, Wiltshire, England, United Kingdom • 22h ago

Inside IR35 Hybrid Working

Please be aware that this role can only be worked within the UK and not Overseas. On behalf of the Ministry of Defence (MoD) we are looking for a Cost Modeller (Inside IR35) for a contract up to until 28.03.2026 on...

22h ago

Apply

Senior Network Specialist

Public Sector Resourcing • Contract • London, Greater London, England, United Kingdom • 22h ago

Inside IR35 Hybrid Working

Please be aware that this role can only be worked within the UK and not Overseas. On behalf of the Cabinet Office, we are looking for a Senior Network Specialist Inside IR35 for a four month contract based Hybrid Lo...

22h ago

Apply

Commercial Manager

Public Sector Resourcing • Contract • London, Greater London, England, United Kingdom • 22h ago

Inside IR35 Hybrid Working

Please be aware that this role can only be worked within the UK and not Overseas. On behalf of DEFRA we are looking for a Commercial Manager (Inside IR35) for a 9 month contract on a hybrid basis in London (1-2 d...

22h ago

Apply

Senior DevOps Engineer

Public Sector Resourcing • Contract • United Kingdom • 22h ago

Inside IR35 Hybrid Working 12 months

Please be aware that this role can only be worked within the UK and not Overseas. On behalf of DWP, we are looking for a Senior DevOps Engineer for a 12 month contract (Inside IR35) based hybrid in Birmingham, Black...

22h ago

Apply