Data Engineer (SQL and PySpark)

Data Engineer

Location: Dunstable (near Luton) - Hybrid (up to 2 days onsite) Rate: 549 per day (Inside IR35 / Umbrella) Contract: Initial term until end of August

Overview

Whitbread is seeking a hands-on Data Engineer to build and maintain scalable, production-grade data pipelines within reusable, modular frameworks. This role focuses on engineering high-quality, durable solutions rather than one-off development.

Key Responsibilities

• Design and develop end-to-end data pipelines using reusable frameworks
• Build scalable data solutions using Python, SQL, and PySpark
• Create modular frameworks separating configuration from orchestration
• Implement robust automated testing (unit, integration, regression)
• Establish and enforce data quality controls (schema, nulls, row counts, integrity checks)
• Contribute to CI/CD pipelines and Git-based workflows
• Troubleshoot and optimise data pipelines for reliability and performance

Required Experience

• Strong Data Engineering background
• Advanced Python and SQL skills
• Experience with PySpark or distributed processing tools
• Proven track record building reusable data frameworks
• Strong testing experience (pytest, mock data, data validation techniques)
• Solid understanding of data quality, integrity, and pipeline behaviour
• Experience with CI/CD, Git, and code review processes

Desirable

• Experience in enterprise or cloud-based data environments
• Exposure to dbt, Great Expectations, or similar tools
• Experience in retail, hospitality, or customer-focused industries