Data Platform Engineer

Data Platform Engineer
London (Hybrid)
6 Month Contract
£(Apply online only)/day (Inside IR35)

Data Platform Engineer needed with strong AWS cloud platform migration and Terraform expertise.

6 Month Rolling Contract based in London (Hybrid), with occasional travel to the Leeds office.

Hybrid Working - 3-4 days/week remote (WFH) + 1-2 days/week working from the office in London.

A chance to work with a leading global IT transformation business specialising in large-scale Government projects:

• In-depth Data Engineering experience + AWS cloud data platform migration experience.
• The role will focus on Data Engineering, cloud platform migration, infrastructure automation + supporting the delivery of large-scale data processing solutions.
• Supporting a major Data platform modernisation programme including migration of data pipelines, notebooks + data workloads from legacy Databricks environment to modern AWS cloud-based data platforms.
• Strong Terraform + Infrastructure as Code (IaC) skills including developing + maintaining Terraform code to support data platform deployments.
• Supporting deployment of data platform components, jobs, permissions + environment configurations.
• Analysing current Data Engineering solutions + identifying data migration requirements.
• Onboarding datasets, users + workloads onto target platform.
• Data Engineering: Python, PySpark, SQL, Data Pipeline Development, ETL/ELT Design, Data Modelling, Data Quality, Data Validation.
• AWS Cloud Platform, S3, IAM, CI/CD concepts, DevOps principles, Agile Delivery.
• Advantageous Skills: Databricks, Palantir Foundry, Foundry Pipeline Builder, Ontology concepts, Delta Lake, Secure Data Environment (SDE) experience, NHS / Healthcare data experience.
• Government / (url removed) / Public Sector domain experience strongly preferred.
• Must be active SC Cleared or fully eligible to undergo the full SC Security Clearance process.