Lead Data Engineer (Azure and Databricks)

LEAD DATA ENGINEER£85,000 + BENEFITSPRIMARILY REMOTEThis is a standout opportunity to take ownership of a modern data platform and drive the evolution of a Databricks-centric environment at scale.THE COMPANY:This client are a well-established organisation with a strong engineering culture and a growing Data and Machine Learning function. The team is collaborative, supportive and operates with solid engineering principles at its core. With flexible-by-choice working, a positive work-life balance and a commitment to technical excellence, this is an environment where you can make a visible impact while continuing to grow your expertiseTHE ROLE:You will focus on the design, build and optimisation of the Azure Databricks Lakehouse platform, ensuring it is scalable, secure and reliable. You will work closely with engineers and stakeholders across the business, providing technical leadership and taking ownership of key data platform initiatives.Key responsibilities include: Developing and deploying the Lakehouse platform in Azure.Owning Databricks engineering, administration and platform optimisation. Designing end-to-end data platform solutionsLeading implementation using Databricks, PySpark, Spark SQL and Azure Data Factory.Creating and maintaining CI/CD pipelines and automated testing frameworks.Developing APIs to support integrationImplementing monitoring, logging and alerting for platform reliability.YOUR SKILLS AND EXPERIENCE:Deep expertise in Databricks, PySpark, Python and ..... full job details .....