Data Engineer (AWS) - Active SC

Job Title: Data Engineer (AWS)
Rate: £450 (Inside IR35)
Duration: 6 months
Location: Remote
Clearance: Active SC
Stages: 1 Stage

Key Responsibilities

• Design, develop, and maintain scalable ETL/ELT data pipelines using AWS cloud services.
• Build and optimize data ingestion, transformation, and storage solutions for structured and unstructured data.
• Develop data solutions using AWS services such as Glue, Lambda, S3, Redshift, Athena, and EMR.
• Implement data quality, validation, governance, and monitoring processes.
• Collaborate with Data Architects, Business Analysts, Data Scientists, and stakeholders to deliver data-driven solutions.
• Design and maintain data models, data warehouses, and data lakes.
• Ensure compliance with security, governance, GDPR, and DWP data standards.
• Support CI/CD implementation and infrastructure automation using DevOps practices.
• Troubleshoot and resolve data processing, performance, and integration issues.
• Document technical solutions and contribute to best practices across engineering teams.

Required Skills & Experience

• Strong experience in Data Engineering within AWS cloud environments.
• Proficiency in Python and SQL for data processing and transformation.
• Hands-on experience with AWS services including:
  • AWS S3
  • AWS Glue
  • AWS Lambda
  • Amazon Redshift
  • Amazon Athena
  • AWS EMR
  • AWS IAM
  • AWS CloudWatch
• Experience building ETL/ELT pipelines and data integration solutions.
• Strong knowledge of relational and non-relational databases.
• Experience with data warehousing and data lake architectures.
• Understanding of Agile and Scrum methodologies.
• Experience with version control systems such as Git.
• Knowledge of CI/CD pipelines and DevOps practices.