SC Cleared Data Engineer - Unix/ETL

Data Engineer
Clearance Required: SC
Duration: 6 months
Location: Telford with 2 days/week in office
IR35 Status: Mandated PAYE only

An experienced Data Engineer is required to support the CDW SA team in delivering DWIT Informatica Advanced Scans across Legacy data warehouses. This role is a key enabler for the strategic migration from Legacy data warehouses to the new Data Lakehouse architecture.

The successful candidate will work closely with DWIT and CDW stakeholders to establish a comprehensive and accurate as is view of each Legacy warehouse, leveraging Informatica Advanced Scanning capabilities wherever possible.

Key Responsibilities:

• Perform detailed analysis of Legacy data warehouses using Informatica Advanced Scanning techniques.
• Produce a complete and accurate as is representation of each data warehouse.

Identify and document all inbound data feeds consumed by CDW, including:

• Source/origin systems
• Data formats
• Full feed by feed data content

Capture and document the actual metadata held within the data warehouse, including:

• Table structures
• Field names and definitions

Identify and document all outbound data feeds from the data warehouse, including:

• Consuming systems or platforms
• Full feed by feed data content
• Outbound metadata (tables, fields, and structures)
• Where possible, generate bespoke outputs from Informatica Advanced Scanning for each Legacy warehouse to support analysis and migration planning.
• Collaborate with architecture, data, and migration teams to ensure outputs are aligned to Data Lakehouse migration objectives.
• Ensure documentation is clear, accurate, and suitable for use in downstream migration and governance activities.
  

Required Skills and Experience:

• Strong experience with Unix Shell Scripting
• PL/SQL and Oracle SQL
• Maestro/TWS scheduling tools
• ETL concepts and implementations
• Command line tools (PuTTY/CLI)
• File transfer tools (eg WinSCP)
• Use of text and documentation tools (eg Notepad , Word or equivalent)

Desirable Knowledge and Experience:

• SA Profiles extracts
• SA MARTs
• SA Warehouse structures and concepts
• Caseflow and KBS
• Authorete
• Eureka
• Business Objects tooling:
• BO Infoview
• BO Developer
• BO CMC
• BO Import Wizard

Additional Information:
This role is hands on and delivery focused, supporting a critical phase of Legacy to Lakehouse migration.
Strong attention to detail, documentation quality, and stakeholder collaboration are essential.