Atrium Workforce Solutions UK Limited logo

Senior Data Engineer - Dublin

Atrium Workforce Solutions UK Limited
1 hour ago
Contract
Dublin
Ireland
€510 - €651 EUR daily

Senior Data Engineer - Dublin

Atrium EMEA is looking for an accomplished Senior Data Engineer with experience building scalable data pipelines and streaming solutions using Databricks, PySpark and Azure Data Lake. Strong in SQL, Python and ETL/ELT, with a focus on simplicity, quality and delivery. This is a hands-on delivery role focused on building, optimizing, and maintaining scalable data pipelines using the Azure data platform. The ideal candidate is pragmatic, delivery-oriented, and collaborative, someone who can design fit-for-purpose solutions, work closely with leads and peers, and contribute positively to team culture. 3 days onsite work in Dublin Office and 2 days remote work each week. PAYE/Umbrella or Irish Limited Company

* Design, build, and maintain scalable data pipelines using Azure Databricks (PySpark) and Azure Data Lake. Hands on implementation experience in event-based or streaming ingestion pipelines (Event Hub, Kafka, etc.).
* Develop reliable ETL/ELT workflows, ensuring data quality, performance, and operational stability. Optimize Spark workloads with a focus on simplicity, efficiency, and maintainability.
* Implement agreed designs, review solutions, and continuously improve engineering practices. Participate in peer code reviews, applying best practices and constructive feedback.
* Troubleshoot production issues proactively and support operational excellence.
* Collaborate effectively with cross-functional teams across Ireland and the US, communicating clearly and professionally.

Essential:
* Azure Databricks
* PySpark/Azure Data Lake
* ADF/orchestration tools
* Solid programming experience in SQL and python.
* Good understanding of ETL/ELT best practices, data modelling, and distributed data processing.
* Experience working in production-grade data platforms.
* Strong communication skills and a collaborative, professional working style.
* Ability to take feedback positively and adapt solutions to team standards.
* Delivers pragmatic, fit-for-purpose solutions aligned to agreed designs.
* The Successful candidate will prioritize simplicity, maintainability, delivery over over-engineering.
* Communicates clearly, constructively, and professionally.
* Works reliably with leads and peers without unnecessary friction.
* Contributes positively to team culture and engineering standards.

Click Apply now/Contact Lianne to be considered for the Senior Data Engineer - Dublin role