Scala Engineer/Data Engineer - Remote and London - 6 months + - £568.75 per day
Blue chip client is urgently looking for a Scala Engineer
Clearance Required: BPSS
Duration: 6 months
Location: London - mainly remote working with 1 day per month at office for co-working days
IR35 Status: PAYE only
Job Description:
Grade 06/07
Location: Stratford, London (currently mainly remote working with 1 day per month at office for co-working days)
What is the Customer Insight Platform (CIP)?
CIP is composed of multiple agile, lean teams who together provide a platform and services to collect, evaluate and analyse customer interaction data.
Context: Teams across CIP
CIP focuses on capturing customer interaction data across the CLIENT estate and making it easily available to a wide audience through several different channels.
CIP processes and stores a vast amount of customer interaction data, using cutting edge & emerging technologies to perform bulk operations at scale, whilst operating, maintaining, and improving a critical platform that our consumers depend on.
It also provides several different channels that allow teams within CLIENT to access and analyse the data in a digestible format to support their day-to-day responsibilities.
Context: CIP Insights & Reputation Team (CIR)
CIP is driven by the principal need to detect and prevent fraudulent access to taxpayer data and prevent organised repayment fraud. Our team splits this process into two phases:
Attribute Reputation
We build, operate and maintain services that prioritise collecting high quality data, that is verifiable and reputable from Customers; the services we offer can help confirm and validate the data points (or attributes) they have provided. For example:
Bank Accounts
Check the sort code exists
Check against a Third-Party API to confirm that the Sort Code, Account Number and Name provided match the name held by the Bank
Addresses
Ingest UK Postal Data from Post Office and Ordnance Survey data
Provide a postcode lookup for addresses
Phone Numbers
A verification service that sends a text message via a Third-Party to confirm that the User has access to the mobile device and number provided.
Emails
A verification service that sends an email to confirm that the User has access to the email they have provided
We are constantly building an enhancing these services to continually improve the data attribute quality held by CLIENT. We also continually ingest many other attributes of interest from all transactions across CLIENT that are captured as part of Audit Events.
Insights
The process through which large amounts of data are collated from tax transactions to glean insights into common attributes. In particular, we assert their validity and derive risk scores for transactions based on whether the attributes in question, or other attributes used in combination with that attribute, have been used in historic transactions associated with past suspicious or fraudulent activity.
Collaboration with other data product and Front End product teams will form the core of creating a frictionless customer experience to exploit the digital audit data that CIP holds.
Insights from Attribute Reputation are crucial for CLIENT services, and the CIR team is pioneering data sharing with other government departments and local authorities.
Desired behaviours
Be proactive
Responsible and motivated self-starter
User centric attitude
Prioritise people over processes
Drive lean results; understand the value of iterative delivery
Be evidence driven
Advocate for doing the right thing'
Help others understand your work through co-participatory design, pairing, demos and documentation
Make complex look and sound simple
Be kind, creative and convincing
Role description
The CIP Insights & Reputation team is seeking a Software/Data Engineer to help develop and maintain both the Attribute and Insights Data Products. We support services that run both on the Multi-Channel Digital Tax Platform (MDTP) and the Customer Insights Platform (CIP).
The Software Engineer will be part of a vibrant multi-disciplinary team. They should be comfortable around Back End coding languages (Scala/Python), Front End languages (HTML/CSS/JS), development frameworks (Play/Spark), Agile Methodologies/Practices (Kanban/Scrum/Sprint), Operational Support (Kibana/Grafana), CI/CD (Jenkins/Airflow), RESTful APIs, Databases (MongoDB, Postgres, Hudi), AWS (Aurora RDS, S3, ECS, Secrets Manager), Infrastructure as code (Terraform) and third-party libraries.
How we work:
We favour:
Breaking down a high-level problem as a team upfront and delivering the core value first
Delivering individual business benefits to production, rather than bundling tasks together
Collaboration, communication, regular pairing and thoughtful course-correction
Taking the time to write simple and easy to maintain code
Willingness to make and participate in improvements for the greater good of CIP
Working cross-discipline rather than adhering to tightly defined roles.
Common tasks including to:
Participate in the design and creation of scalable software
Design and develop clean functioning, testable code on the frontends and backends, write effective APIs, develop and manage well-functioning databases and applications with security and data protection settings
Collaborate with the CIR product owner, business analyst, data engineers and the wider CIP teams to ideate software solutions
Peer reviewing pull requests
Testing and fixing bugs or other coding issues
Set up, maintain and improve continuous integration
Support live services with troubleshooting and monitoring
Write technical documentation
Knowledge & experience
Knowledge of Front End languages (HTML, CSS, JavaScript)
Knowledge of multiple Back End languages (eg Scala, Java, Python) and libraries
Familiarity with databases (eg Postgres, MongoDB, Splunk)
Familiarity with big data tools (Spark, Presto, AWS EMR)
Proven experience as a Full Stack Developer or similar role
Experience coding in continuous integration context
AWS suite experience
Understands the importance of testing and automation
Working in a lean, agile environment
Working in a you build it you run it team
Experience coding in continuous integration context
Excellent communication
Team player
Great attention to detail
An analytical mind
Skills & technologies
Essential:
Scala/Java
Play Framework (or other MVC/Rest API frameworks)
SQL DB (eg Aurora, Postgres)
NoSQL DB (eg MongoDB)
Linux/Unix
AWS (S3, ECS, Lamda, etc.)
HTML/CSS/JavaScript
Terraform
SBT
Continuous Integration (Jenkins)
Agile methodologies
Desirable:
Python
Airflow
Docker
Kibana
Grafana
Please send CV for full details and immediate interviews. We are a preferred supplier to the client.