Senior Data & DevOps Engineer

Drest • TRAFFIC • Not Specified, Not Specified, United Kingdom • 6h ago

The Senior Data and DevOps Engineer is responsible for the performance, scalability, and reliability of Drest's data infrastructure and pipelines. This role ensures the efficient ingestion, transformation, and delivery of high-volume data, while also maintaining robust, cost-effective cloud operations. As a hands-on engineer, the Senior Data and DevOps Engineer is actively involved in building pipelines, defining infrastructure as code, and supporting critical systems. Reporting to the Devops Lead Engineer, they work closely with data science, backend, and the platform team to enable high-quality analytics and drive technical excellence across data and infrastructure.

What you will be accountable for:

Design, build, and maintain robust data pipelines capable of handling tens of millions of events per day in both batch and real-time processing contexts.
Manage and optimise AWS cloud infrastructure, ensuring high availability, performance, cost-efficiency, and security.
Develop infrastructure-as-code using Terraform, supporting scalable and maintainable infrastructure deployments.
Build and monitor data warehouse solutions (e.g. Redshift), ensuring data is accessible, clean, and well-modelled for analytics and product teams.
Drive system performance and operational excellence by improving observability, uptime, and deployment processes across data and platform systems.

What the Senior Data and Devops Engineerwill be responsible for:

Design, implement and maintain scalable and reliable data pipelines
Build, optimize and monitor data warehousing solutions with Redshift and other columnar data stores
Develop infrastructure-as-code using Terraform to provision and manage cloud infrastructure
Own and manage AWS-based systems, ensuring cost-effective, secure and high-performance operations
Support and enhance the data and platform stack to ensure uptime, observability, and recoverability of key systems
Collaborate with engineering and product teams to ensure data needs are met and infrastructure bottlenecks are identified early
Support analytics and reporting workflows by making data accessible, clean, and well-modeled
Implement system performance improvements and improve alerting, monitoring and release processes

5+ years of experience in data engineering, including multiple end-to-end pipeline builds
Solid experience with AWS cloud services, including S3, EC2, Lambda, RDS, Redshift, Glue, and Kinesis, Mongodb, Postgresql
Proven expertise in Terraform and infrastructure-as-code practices
Strong SQL and data modeling skills, and experience with both SQL and NoSQL data stores
Strong understanding of dbt (or equivalent) and Tableau
Hands-on experience with Python for data processing and automation tasks
A background working in environments with high throughput data (millions of events per hour)
Understanding of best practices around security, scalability, and maintainability in cloud-native systems
Comfort working independently in a fast-paced, highly collaborative environment
Great communication skills, ability to explain complex systems clearly to technical and non-technical stakeholders
Familiarity with Docker, Kubernetes, or other container orchestration platforms
A willingness to be available outside standard working hours when needed to support critical issues or key deliveries.

It would be a bonus if you have

Experience in the gaming industry
Experience with event-driven applications
Exposure to CI/CD pipelines and automated testing for data infrastructure
Experience with additional data warehouses (BigQuery, Snowflake, etc.)

Related Jobs

Kubernetes Engineer

Wenham Carter Ltd • APPLICATION • Not Specified, Not Specified, United Kingdom • 1h ago

Engineer

We're supporting a major IT consultancy on a search for a Kubernetes Engineer, they are engaged with a global bank on a large-scale migration project, shifting from an on-prem Hadoop-based data platform to a Kubernetes-b...

1h ago

Apply

Technical Support Frontend Engineer (UX)

Proactive Appointments • APPLICATION • Surrey, Not Specified, United Kingdom • 1h ago

Engineer

Technical Support Frontend Engineer (UX) Our client is looking for a Technical Support Engineer with specifically UX and Front End experience. You will provides technical support to field engineers, technicians and produ...

1h ago

Apply

DV Cleared Network Engineer

Damia Group Ltd • APPLICATION • London, Not Specified, United Kingdom • 1h ago

Engineer

DV Cleared Network Architect - 6 months+ - £700-£720pd Inside IR35- Hybrid working of 2/3 days on site in Vauxhall or Stratford My client are looking for a Network Engineer who will work on: . Strategic network delivery...

1h ago

Apply

Apple Mac EUC Engineer

Refreshing Recruitment Limited • APPLICATION • London, Not Specified, United Kingdom • 1h ago

Engineer

Location: Central London/Hybrid Working Contract: 6months + Rate: c £550 per day DOE We are seeking an experienced Apple Mac EUC Engineer to join a specialist End User Compute (EUC) IT services provider modernising secur...

1h ago

Apply

Senior Delivery Engineer - Arista Spine & Leaf (Inside IR35)

WNTD • APPLICATION • London, Not Specified, United Kingdom • 1h ago

Engineer

Job Title: Senior Delivery Engineer - Arista Spine & Leaf (Inside IR35) Location: Ideally 1 day per week onsite in London Contract Rate: £490 per day (Inside IR35) Contract Type: 6months + (likely extension) Role Ove...

1h ago

Apply

Senior Golang Engineer

Salt • APPLICATION • London, Not Specified, United Kingdom • £330 - £350 / * • 1h ago

Engineer

Senior Golang Software Engineer Rate: £330-£350 per day (Inside IR35) Contract: 6-12 months Location: Hybrid - 3 days per week onsite in London or Burgess Hill We're hiring a Senior Golang Software Engineer to join a glo...

1h ago

Apply

Lead Software Engineer

Public Sector Resourcing CWS • TRAFFIC • Manchester, Not Specified, United Kingdom • 5h ago

Engineer

On behalf of DWP, we are looking for a Lead Software Engineer for a 12 month (Inside IR35) contract based Hybrid in either Manchester, Newcastle, Leeds or Birmingham. The Department for Work and Pensions (DWP) is respons...

5h ago

Apply

Site Reliability Engineer

Morgan Hunt UK Limited • TRAFFIC • Edinburgh, Not Specified, United Kingdom • 6h ago

Engineer

Location: Remote, with occasional travel to Scotland Employment Type: 6 month Contract Rate: £550 per day, Outside of IR35 Role Overview Morgan Hunt are seeking an experienced Site Reliability Engineer (SRE) / Unix Infra...

6h ago

Apply

Senior Site Reliability Engineer (SRE) / Unix

Morgan Hunt UK Limited • TRAFFIC • London, Not Specified, United Kingdom • 6h ago

Engineer

6h ago

Apply

Senior Data Engineer

Antler • TRAFFIC • London, Not Specified, United Kingdom • 6h ago

Engineer

About Prima Mente Prima Mente's goal is to deeply understand the brain, to protect the brain from neurological disease and enhance the brain in health. We do this by generating our own data, building brain foundation mod...

6h ago

Apply