Principal Data Engineer

1610 BioMed Central Limited • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

The role is to provide data engineering and architectural leadership to teams building core data products and services powering Springer Nature's researcher brands.

About you

You're happy working across teams and departments to align and coordinate the development and delivery of data-centric solutions. You spot risks and opportunities and fill in the gaps between delivery teams. You help remove blockers throughout the data supply chain. You produce demos and MVPs for analysis and to test out possible solutions that you can use to demonstrate ideas or gaps. You take an iterative approach to solving complex problems and seek feedback to quickly arrive at the best result.

Role Responsibilities:

Coordinate across teams to ensure consistent data product development and utilization, establishing and delivering the defined data architecture. This includes working with the Data Architect to understand team needs, use cases, and constraints for the data ecosystems.

Work with both data producers and consumers to optimize existing data products and the data within them to meet evolving business needs. Advocate for teams delivering data-as-a-product.

Collaborate on the design of the research data ecosystem, addressing disambiguation, data product creation, API development, model building, harmonization, standardization, and governance.

Adopt company-standardized technology, including cloud platforms, and collaborate with technology teams to improve offerings. Consider the best technology for data teams, given varying levels of technical literacy.

Work with data privacy and governance teams to ensure data security and appropriate accessibility, adhering to relevant regulations (e.g., GDPR).

Build relationships with other departments/disciplines/groups to ensure alignment and collaboration. Clarify constraints, trade-offs, or important decisions to non-technical stakeholders. Introduce business and product leaders to data and data engineering concepts and align solutions to user and business needs.

Foster a safe and collaborative technical community, growing technical knowledge and cultivating knowledge sharing in and across teams.

Provide data-related technical and architectural assistance to product delivery teams and IT when needed. Assist and support tech leads and senior developers to help unblock issues.

Skills & Experience

Proven experience designing, delivering, and scaling data-intensive applications. Demonstrated ability to architect data solutions that meet performance, scalability, and security requirements.

Experience working on transformation projects involving introducing new technologies and ways of working within a business. Ability to drive adoption of new data architectures and technologies.

Ability to clarify and uncover technical requirements, risks, and opportunities with tech leads and collaborators. Experience translating business needs into technical specifications.

Where necessary, advocate for and enforce cross-functional technical and data requirements (e.g., GDPR, security, operability, etc.)

Deep, demonstrable experience delivering with various types of databases and design, including relational databases, NoSQL databases, graph databases, vector stores, and data warehouses, particularly in cloud environments. Experience with data modeling techniques and data warehousing methodologies (e.g., Kimball, Inmon, Data Vault).

Hands-on experience with cloud data platforms and services (e.g., AWS, Azure, GCP). Familiarity with cloud-native data architectures and technologies.

Experience with data management tools and processes.

Experience with AI and Machine Learning, including MLOps practices.

Experience with decentralized Data Mesh and Data Product architecture principles.

What will you be doing

1 month:

Collaborate with key stakeholders (product managers, engineers, architects) to understand the current state of the research data landscape and identify immediate opportunities for improvement.

Document the as-is data/technical landscape for research data and the wider domain.

Begin building relationships and feedback loops with data governance, security, and other relevant groups to ensure alignment on data standards, security policies, and architectural principles.

Start to map out the existing data sources and identify potential issues that need to be addressed.

3 months:

Maintain a high-level roadmap for the development of the research data ecosystem, outlining key milestones and deliverables for the next 6-12 months, and present to senior leadership.

Determine how the technical architecture can support delivery autonomy while supporting consistent user journeys across our platforms.

Perform feasibility analysis and provide recommendations on build vs. buy for systems that support agile development, scalability, and data governance requirements.

Create an architectural forum to bring together architects and tech leads in the research data initiatives.

6 months:

Refine the roadmap and architecture based on feedback from initial delivery, incorporating lessons learned and adjusting priorities as needed.

Scale successful approaches to other areas of the research data ecosystem, empowering teams.

Develop and communicate a clear vision for the future of the research data ecosystem, highlighting its role in supporting strategic organizational goals.

Time left to apply: End Date: July 31, 2025 (6 days left to apply)

We are an ambitious and dynamic organization, home to some of the best-known names in research, educational, and professional publishing.

Working at the heart of a changing industry, we are always looking for great people who care about delivering quality to our customers and the communities we work alongside. In return, we offer opportunities to learn from some of the best in the business, with a culture that encourages curiosity and empowers people to find solutions and act on their instincts. Whether you are starting your career or are an experienced professional, we invite you to explore our current vacancies and learn more about the roles we offer.

About Us

We are a global and progressive business, founded on a heritage of trusted and respected brands-including Springer, founded in 1842, Macmillan, founded in 1843, and Nature, first published in 1869.

Nearly two centuries of progress and advancement in science and education have helped shape our business. Research and learning remain our cornerstone, and we will continue to open doors to discovery through trusted brands and innovative products and services. Springer Nature Group was created in May 2015 through the combination of Nature Publishing Group, Macmillan Education, and Springer Science+Business Media.

Related Jobs

Senior Software Engineer

Quality Control Specialist - Pest Control • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

Our consulting client are looking for a Software Engineer to join them on an initial 6 month (+EXT) contract position. This position will be inside IR35 and hybrid in C. London with 2/3 days in the office. The role will...

12h ago

Apply

Senior Fullstack Engineer (Frontend)

IO Associates • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer Outside IR35

Senior Fullstack Engineer - Digital Scale-Up £450-£500/day Outside IR35 Hybrid - 1 day/week in London 3-month contract (likely to extend) We're hiring Senior Fullstack Engineers for a rapidly growing digital company expa...

12h ago

Apply

software engineer TYK

Lorien • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

Job Title: Senior / Lead Backend Software Engineer (Contract) - banking indusrry - TYK experince Location: hybrid (UK-based only) IR35 Status: Inside IR35 Start Date: ASAP About the Role: We are looking for an experience...

12h ago

Apply

Senior Test Engineer - AWS Node Testing - FTC UK

Spyro Soft • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

Location London or Salford Hybrid - at least 1 day a week in the office eligibility to work in the UK required Role Overview As a Senior Test Engineer, we're looking for an experienced test specialist to work with our me...

12h ago

Apply

Senior Test Engineer - AWS Node Testing (Content Metadata Testing Team) - FTC UK

Spyro Soft • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

12h ago

Apply

Full Stack Engineer

Stott and May • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

Full Stack Engineer Start: ASAP Duration: ongoing Location: central London (hybrid, negotiable) Pay: £250-270 per day (inside IR35) We are looking for a full stack engineer to develop modern anti-fraud services. This pos...

12h ago

Apply

Software Engineer ï - Python ï - Financial Markets

Quality Control Specialist - Pest Control • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

You will be responsible for developing a domain specific language and a test environment for this language, with an emphasis on properly utilising the Python ecosystem and applying best practice software engineering and...

12h ago

Apply

Digital Implementation Engineer - Contract

Harnham Ltd • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

Digital Implementation Engineer (Contract) Leading Travel Brand London - Hybrid £500-£600 per day Inside IR35 Are you a hands-on Digital Implementation Engineer with deep expertise in GA4 and Google Tag Manager? I'm work...

12h ago

Apply

Senior Infrastructure Engineer

Simply Business • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

Social network you want to login/join with: Here's what you'll be doing: As a Senior BizOps Infrastructure Engineer you'll be a key player in managing our global, multi-site IT infrastructure, ensuring its smooth operati...

12h ago

Apply

Senior Backend Engineer (Go)

Rollbar, Inc. • TRAFFIC • London, Not Specified, United Kingdom • 12h ago

Engineer

Arenko is an Energy Tech company using advanced software to optimise energy storage, making electricity grids more flexible, reliable, and zero-carbon. Our platform enables grid operators (such as National Grid in the UK...

12h ago

Apply