Senior Data & DevOps Engineer

Drest • TRAFFIC • Not Specified, Not Specified, United Kingdom • 1w ago

The Senior Data and DevOps Engineer is responsible for the performance, scalability, and reliability of Drest's data infrastructure and pipelines. This role ensures the efficient ingestion, transformation, and delivery of high-volume data, while also maintaining robust, cost-effective cloud operations. As a hands-on engineer, the Senior Data and DevOps Engineer is actively involved in building pipelines, defining infrastructure as code, and supporting critical systems. Reporting to the Devops Lead Engineer, they work closely with data science, backend, and the platform team to enable high-quality analytics and drive technical excellence across data and infrastructure.

What you will be accountable for:

Design, build, and maintain robust data pipelines capable of handling tens of millions of events per day in both batch and real-time processing contexts.
Manage and optimise AWS cloud infrastructure, ensuring high availability, performance, cost-efficiency, and security.
Develop infrastructure-as-code using Terraform, supporting scalable and maintainable infrastructure deployments.
Build and monitor data warehouse solutions (e.g. Redshift), ensuring data is accessible, clean, and well-modelled for analytics and product teams.
Drive system performance and operational excellence by improving observability, uptime, and deployment processes across data and platform systems.

What the Senior Data and Devops Engineerwill be responsible for:

Design, implement and maintain scalable and reliable data pipelines
Build, optimize and monitor data warehousing solutions with Redshift and other columnar data stores
Develop infrastructure-as-code using Terraform to provision and manage cloud infrastructure
Own and manage AWS-based systems, ensuring cost-effective, secure and high-performance operations
Support and enhance the data and platform stack to ensure uptime, observability, and recoverability of key systems
Collaborate with engineering and product teams to ensure data needs are met and infrastructure bottlenecks are identified early
Support analytics and reporting workflows by making data accessible, clean, and well-modeled
Implement system performance improvements and improve alerting, monitoring and release processes

5+ years of experience in data engineering, including multiple end-to-end pipeline builds
Solid experience with AWS cloud services, including S3, EC2, Lambda, RDS, Redshift, Glue, and Kinesis, Mongodb, Postgresql
Proven expertise in Terraform and infrastructure-as-code practices
Strong SQL and data modeling skills, and experience with both SQL and NoSQL data stores
Strong understanding of dbt (or equivalent) and Tableau
Hands-on experience with Python for data processing and automation tasks
A background working in environments with high throughput data (millions of events per hour)
Understanding of best practices around security, scalability, and maintainability in cloud-native systems
Comfort working independently in a fast-paced, highly collaborative environment
Great communication skills, ability to explain complex systems clearly to technical and non-technical stakeholders
Familiarity with Docker, Kubernetes, or other container orchestration platforms
A willingness to be available outside standard working hours when needed to support critical issues or key deliveries.

It would be a bonus if you have

Experience in the gaming industry
Experience with event-driven applications
Exposure to CI/CD pipelines and automated testing for data infrastructure
Experience with additional data warehouses (BigQuery, Snowflake, etc.)

Related Jobs

Data Science/Machine Learning Engineers - ML AI

Alpha Associates • APPLICATION • London, Not Specified, United Kingdom • £500 / * • 3h ago

Engineer

Data Science/Machine Learning Engineers - AI Assessment Models Initial 6 months | £dependant on experience per day (Inside IR35) | Likely extensions | Hybrid - London/Remote Overview We are supporting a large exam and qu...

3h ago

Apply

Integration Engineer - M&A - Outside IR35

Lorien • TRAFFIC • London, Not Specified, United Kingdom • 4h ago

Engineer Outside IR35

Integration Engineer - M&A - Outside IR35 Job Type Contract/Temporary Location City of London, London Negotiable Job Ref BBBH70 Date Added August 14th, 2025 Consultant Georgina Frost Integration Engineer - M&A -...

4h ago

Apply

Senior Software Engineer

Square One Resources • APPLICATION • Birmingham, Not Specified, United Kingdom • £500 - £560 / * • 4h ago

Engineer

Job Title: Senior Software Engineer Location: Birmingham/Sheffield/Edinburgh (3 Days on site per week) Salary/Rate: up to £560 per Day Inside IR35 Start Date: 01/09/2025 Job Type: Contract Until the end of the year Compa...

4h ago

Apply

Dynatrace Engineer - SC Cleared

Stott and May • APPLICATION • London, Not Specified, United Kingdom • £350 - £425 / * • 4h ago

Engineer

Dynatrace Engineer - SC Cleared Location: London OR Gloucester OR Warrington (Hybrid) Contract Duration: 6 months (starting ASAP) Security Clearance: UK SC Cleared (Mandatory) Overview: We are looking for an experienced...

4h ago

Apply

Contract Python Engineer - DV Cleared

Searchability NS&D • TRAFFIC • London, Not Specified, United Kingdom • £500 - £650 / * • 5h ago

Engineer Outside IR35

CONTRACT PYTHON / DATA ENGINEER - DV CLEARED NEW OUTSIDE IR35 CONTRACT OPPORTUNITY AVAILABLE WITHIN A LEADING NATIONAL SECURITY SME FOR A PYTHON / DATA ENGINEER WITH DV CLEARANCE Contract job opportunity for a Data Engin...

5h ago

Apply

Engineering Manager - Software as a Medical Device (SaMD)

Skin Analytics Ltd • TRAFFIC • London, Not Specified, United Kingdom • 7h ago

Engineer

You will lead a business critical engineering squad responsible for delivering regulated medical AI products in a fast-paced environment. Managing engineers working on AI and SaMD components, you will own the development...

7h ago

Apply

Senior Software Engineer (Web & iPortal)

iProov • TRAFFIC • London, Not Specified, United Kingdom • 7h ago

Engineer

Senior Software Engineer (Web & iPortal) About iProov iProov is the world leader in biometric verification. We are on a mission to make the world a safer place for businesses and consumers and work with fantastic cus...

7h ago

Apply

Engineering Manager - Software as a Medical Device (SaMD)

Skin Analytics • TRAFFIC • London, Not Specified, United Kingdom • 7h ago

Engineer

7h ago

Apply

Senior Full Stack Engineer

Two Circles Ltd • TRAFFIC • London, Not Specified, United Kingdom • 7h ago

Engineer

ROLE: Senior Full Stack Engineer(focus on .Net) OFFICE: London, UK We are Two Circles. We are a Sports & Entertainment Marketing business. We grow audiences and revenues. We do that by knowing fans best. We work with...

7h ago

Apply

Senior Data Engineer

VivaCity • TRAFFIC • London, Not Specified, United Kingdom • 7h ago

Engineer

Senior Data Engineer We are looking for a technical expert with deep data engineering experience, who thrives on solving complex problems, driving business impact, and coaching other engineers. Salary : £70k-£90k Reporti...

7h ago

Apply