Data Engineer

Join a growing team in delivering critical data engineering projects for one of the largest clients in Europe. Lead the transition from legacy systems to cutting-edge Databricks infrastructure.

We have an exciting opportunity for a Data Engineer who is an expert with Databricks & SQL to join our client on a 3-month initial contract.

What you’ll be doing

• Lead the migration of data from legacy DB to Databricks.
• Design, implement, and optimise data pipelines using Databricks, PySpark and SQL to serve business-critical operations.
• Collaborate with engineers, data scientists and product teams to manage infrastructure and ensure it aligns with their needs and workflows.
• Communicate effectively with stakeholders, ensuring that all moving parts are on track and all updates are shared in a clear and timely manner.

What experience you’ll need to apply

• Databricks and SQL expert, with a proven track record in data engineering projects.
• Solid experience with Python and PySpark.
• Strong communication skills with excellent English, able to manage complex projects and liaise with multiple stakeholders.

Highly desirable

• Experience with CI/CD pipelines, testing, and DevOps workflows.
• Experience in MLOps and MLFlow, particularly setting up machine learning infrastructure.

What you’ll get in return for your experience

• £450 – 500 p/day outside IR35.
• Good possibility of extension beyond the initial 3-month contract into next year (supporting data science initiatives).

What’s next?

Please apply with an up-to-date CV and I will be in touch.