Lead Data Engineer (Databricks)

About usLead Data Engineer (Databricks)River Water Quality ProgrammeWarrington (Hybrid - 3 days onsite per week)At United Utilities, we''re committed to protecting the environment that millions of people depend on every day. As part of our Digital Services team, you''ll play a pivotal role in one of our most important and high-impact initiatives: near real time monitoring of river water quality.We''re looking for a Lead Data Engineer to take technical ownership of modern, scalable data platforms that turn complex environmental and telemetry data into trusted insights for regulators, scientists, and operational teams.What you''ll be doingAs the Lead Data Engineer on our River Water Quality Programme, you''ll design, build, and optimise Databricks-based data pipelines that enable timely, reliable and well-governed data across the organisation.You''ll:Design and develop scalable batch and streaming data pipelines using Databricks, Spark and Delta LakeImplement medallion architecture (bronze/silver/gold) to ensure data quality, lineage and efficient consumptionOptimise Spark jobs and workflows to meet near real-time monitoring SLAsBuild and maintain streaming pipelines using Structured Streaming and Delta Live TablesEnsure strong data governance, including schema enforcement, validation rules and ACID complianceOrchestrate and automate pipelines using Databricks Jobs, APIs or cloud-native schedulersCollaborate with data scientists, analysts and environmental specialists to ..... full job details .....