Databricks Data Engineer

Harnham • Contract • Remote (United Kingdom) • £500 - £600 / day • 4d ago

A leading eCommerce brand is looking for a Data Platform Engineer to play a key role in evolving their data ecosystem. This is an exciting opportunity to shape how data is built, governed, and leveraged across the business, supporting a platform that impacts millions of users daily.

THE COMPANY

This brand is recognised for its innovation and community-driven approach. With data at the heart of its decision-making, they're investing heavily in scalable, modern data platforms to enable better insights, experimentation, and product development. You'll join a collaborative engineering culture that values autonomy, technical excellence, and continuous improvement.

THE ROLE

As a Data Platform Engineer, you'll be responsible for developing and scaling the company's core data platform, ensuring teams across the business can access, trust, and use data effectively. You'll drive initiatives that improve data quality, observability, and governance, while helping shape a platform-as-a-product mindset.

Key responsibilities include:

Building and maintaining data infrastructure: Develop microservices, pipelines, and backend systems that power analytics and machine learning initiatives.
Driving platform evolution: Design and implement scalable, secure, and efficient data services using tools such as Terraform, Docker, and AWS.
Data governance and observability: Introduce and enhance tooling for data lineage, contracts, monitoring, and cataloguing.
Operational excellence: Lead automation, monitoring, and incident response to maintain high platform reliability.
Cross-functional collaboration: Work with data scientists, ML engineers, analysts, and product teams to understand and meet their data needs.
Mentorship and culture: Support the growth of peers through knowledge sharing and by championing engineering best practices.

YOUR SKILLS AND EXPERIENCE

The successful candidate will have:

Strong experience in Python and a solid foundation in software engineering best practices (testing, CI/CD, automation).
Proven track record of designing, building, and scaling data platforms in production environments.
Hands-on experience with big data technologies such as Airflow, DBT, Databricks, and data catalogue/observability tools (e.g. Monte Carlo, Atlan, Datahub).
Knowledge of cloud infrastructure (AWS or GCP) - including services such as S3, RDS, EMR, ECS, IAM.
Experience with DevOps tooling, particularly Terraform and CI/CD pipelines (e.g. Jenkins).
A proactive, growth-oriented mindset with a passion for modern data and platform technologies.

Nice to Have:

Experience implementing data governance and observability stacks (lineage, data contracts, quality monitoring).
Knowledge of data lake formats (Delta Lake, Parquet, Iceberg, Hudi).
Familiarity with containerisation and streaming technologies (Docker, Kubernetes, Kafka, Flink).
Exposure to lakehouse or medallion architectures within Databricks.

Related Jobs

Application Support Engineer - DV

Hays Specialist Recruitment Limited • Cheltenham, Gloucestershire, United Kingdom • 3h ago

Engineer Outside IR35

DV-Cleared Application Support Engineer Contract - £500-£600 a day Cheltenham - On-Site Hays Technology is recruiting an Application Support Engineer for a secure, on-site contract role in Cheltenham. This position is ou...

3h ago

Apply

ServiceNow Developer - Outside IR35 Contract

Morson Talent • City, Manchester, United Kingdom • 5h ago

Developer Outside IR35

ServiceNow Developer Duration: 6 months (initial) Location: South Manchester (Hybrid - flexible onsite requirements) IR35: Outside IR35 CTC Required: You must have been a resident of the UK for at least the past 3 years....

5h ago

Apply

Technical Architect

Hays Technology • City, Cardiff, United Kingdom • 5h ago

Architect Outside IR35

JOB DETAILS - 500- 550 PER DAY - OUTSIDE IR35 - 6-MONTH CONTRACT - 1 PER WEEK IN CARDIFF OFFICE SKILLS Strong stakeholder and senior management communications skills. Extensive experience in technical discovery, architec...

5h ago

Apply

Syspro Project Manager

SF Recruitment • TRAFFIC • Birmingham, City, United Kingdom • £700 / * • 5h ago

Project Manager Outside IR35

A leading manufacturing business is seeking an experienced ERP Project Manager to oversee the rollout of Syspro across its UK operations. This is a pivotal role in driving system transformation and operational efficiency...

5h ago

Apply

Technical Architect

Hays Technology • TRAFFIC • Cardiff, City, United Kingdom • £500,000 - £550,500 / * • 5h ago

Architect Outside IR35

5h ago

Apply

ServiceNow Developer - Outside IR35 Contract

Morson Talent • TRAFFIC • Manchester, City, United Kingdom • £550 - £650 / * • 5h ago

Developer Outside IR35

5h ago

Apply

SAP Consultant - SAP HCM, Techno Functional - Remote/Some Travel - Outside IR35

Curo Services • APPLICATION • Hertfordshire, Hatfield, United Kingdom • 6h ago

Outside IR35

SAP Consultant - SAP HCM, Techno Functional - Remote/Some Travel - Outside IR35 Our Global Enterprise client is looking for an experienced SAP HCM Techno Functional Consultant with strong Expertise in SAP HCM On-Premises...

6h ago

Apply

Techno Functional Consultant

Click Digital • TRAFFIC • Hertfordshire, Hatfield, United Kingdom • £800 / * • 6h ago

Outside IR35

We are recruiting for a SAP HCM Techno Functional Consultant for a leading IT service provider based in Hatfield. Job Introduction We are looking for an experienced SAP HCM Techno Functional Consultant with strong Expert...

6h ago

Apply

It Manager

Robert Half • TRAFFIC • Lancashire, Rochdale, United Kingdom • 6h ago

Outside IR35

Contract Role: Infrastructure Specialist North West (Travel Required) 350 Outside IR35 (Pending SDS) 6 Month Contract Our client is seeking a data-driven IT professional with strong compliance, reporting, and infrastruct...

6h ago

Apply

Communications Manager

Akkodis • APPLICATION • Yorkshire, Wakefield, United Kingdom • £275 - £310 / * • 7h ago

Outside IR35

Internal Engagement Manager (6-Month Contract, Outside IR35, On site Wakefield) My client is entering an exciting new phase - embedding their refreshed brand and new business strategy. They're looking for an experienced...

7h ago

Apply