Platform Data Engineer

Harnham - Data & Analytics Recruitment • London, United Kingdom • 6h ago

Senior Platform Engineer

£500-£600 per day

Outside IR35

6-months

Join one of the UK's leading online retailers as they evolve their next-generation data platform. This is an opportunity to shape the backbone of a modern data ecosystem, empowering analysts, ML engineers, and data scientists to deliver smarter, faster insights at scale.

The Role

You'll play a key role in designing and engineering platform services that treat data as a core product. This means building scalable, secure, and observable systems that help teams confidently leverage data across the business.

You'll work closely with a wide range of technical and non-technical partners to deliver resilient infrastructure, champion data governance, and mentor others in engineering excellence.

In this role, you will:

Shape the data platform roadmap: Introduce modern observability, quality, and governance frameworks that elevate how teams access and trust data.
Build and scale infrastructure: Develop services, APIs, and data pipelines using modern cloud tooling and automation-first principles.
Drive engineering best practices: Implement CI/CD pipelines, testing frameworks, and container-based deployments to ensure reliability and repeatability.
Lead cross-functional initiatives: Collaborate with product engineers, data scientists, and ML practitioners to understand their workflows and deliver high-impact platform solutions.
Champion operational reliability: Proactively monitor system performance, automate incident response, and strengthen platform resilience.

What You'll Bring

Strong proficiency in Python (or a similar high-level language) with a deep understanding of software engineering best practices - testing, automation, clean code, and CI/CD.
Proven track record building and maintaining scalable data platforms in production, enabling advanced users such as ML and analytics engineers.
Hands-on experience with modern data stack tools - Airflow, DBT, Databricks, and data catalogue/observability solutions like Monte Carlo, Atlan, or DataHub.
Solid understanding of cloud environments (AWS or GCP), including IAM, S3, ECS, RDS, or equivalent services.
Experience implementing Infrastructure as Code (Terraform) and CI/CD pipelines (e.g., Jenkins, GitHub Actions).
A mindset focused on continuous improvement, learning, and staying at the forefront of emerging technologies.

Nice to Have

Experience rolling out data governance and observability frameworks, including lineage tracking, SLAs, and data quality monitoring.
Familiarity with modern data lake table formats such as Delta Lake, Iceberg, or Hudi.
Background in stream processing (Kafka, Flink, or similar ecosystems).
Exposure to containerisation and orchestration technologies such as Docker and Kubernetes.

Related Jobs

Databricks Data Engineer

Harnham - Data & Analytics Recruitment • London, United Kingdom • 6h ago

Engineer Outside IR35

Databricks Data Engineer £500 - £600 per day Outside IR35 We're partnering with a leading online retail company that's transforming the way data and real-time intelligence shape customer experiences. Their mission is to...

6h ago

Apply

Databricks Data Engineer Contract

Harnham - Data & Analytics Recruitment • London, United Kingdom • 6h ago

Engineer Outside IR35

£550-£600pd Outside IR35Remote - UK based applicants only6 months A leading eCommerce brand is looking for a Data Platform Engineer to play a key role in evolving their data ecosystem. This is an exciting opportunity to...

6h ago

Apply

Part Time M365 IT & Security Support Engineer £300 - £350 Outside IR35 Onsite

Opus Recruitment Solutions Ltd • London, United Kingdom • 1d ago

Engineer Outside IR35

Part Time M365 IT & Security Support Engineer £300 - £350 Outside IR35 Onsite We're recruiting an experienced M365 IT & Security Support Engineer to assist our client through a busy transitional period. This 2-mo...

1d ago

Apply

Part Time M365 IT & Security Support Engineer £300 - £350 Outside IR35 Onsite

Opus Recruitment Solutions Ltd • TRAFFIC • London, Not Specified, United Kingdom • £300 - £350 / * • 1d ago

Engineer Outside IR35

1d ago

Apply

Part Time | M365 IT & Security Support Engineer | £300 - £350 | Outside IR35 | Onsite

Opus Recruitment Solutions Ltd • ATS • London, Not Specified, United Kingdom • £300 - £350 / * • 1d ago

Engineer Outside IR35

Part Time | M365 IT & Security Support Engineer | £300 - £350 | Outside IR35 | Onsite We're recruiting an experienced M365 IT & Security Support Engineer to assist our client through a busy transitional period. T...

1d ago

Apply

Contract Data Engineer - eDV Cleared

Searchability NS&D • TRAFFIC • London, Not Specified, United Kingdom • £450 - £650 / * • 1d ago

Engineer Outside IR35

CONTRACT DATA ENGINEER - eDV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A DATA ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Data Engineer National Sec...

1d ago

Apply

Contract Senior Software Engineer - eDV Cleared

Searchability NS&D • TRAFFIC • London, Not Specified, United Kingdom • £500 - £750 / * • 1d ago

Engineer Outside IR35

CONTRACT SENIOR SOFTWARE ENGINEER - eDV CLEARED NEW CONTRACT JOB OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY COMPANY FOR A SENIOR SOFTWARE ENGINEER WITH eDV CLEARANCE Contract job opportunity for a Senior So...

1d ago

Apply

Contract Palantir Foundry Engineer - DV Cleared

Searchability NS&D • TRAFFIC • London, Not Specified, United Kingdom • £500 - £650 / * • 1d ago

Engineer Outside IR35

CONTRACT PALANTIR DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A HIGHLY SECURE DELIVERY PROGRAMME FOR A DV CLEARED PALANTIR FOUNDRY DATA ENGINEER. Contract opportunity for a Palantir...

1d ago

Apply

Part Time | M365 IT & Security Support Engineer | £300 - £350 | Outside IR35 | Onsite

Opus RS • London, United Kingdom • £37 - £50 / hour • 2d ago

Engineer Outside IR35

Part Time | M365 IT & Security Support Engineer | £300 - £350 | Outside IR35 | Onsite We’re recruiting an experienced M365 IT & Security Support Engineer to assist our client through a busy transitional period. T...

2d ago

Apply

Security and IT Systems Administrator / IT Support Engineer - SC Cleared Environment

MLC Partners • TRAFFIC • London, Not Specified, United Kingdom • £200 / * • 2d ago

Engineer Outside IR35

IT Systems & Security Administrator to support and manage a secure MS digital infrastructure environment. This role requires active SC clearance and experience in Microsoft 365 and Azure environments. Outside IR35. L...

2d ago

Apply