Databricks Data Engineer

Databricks Data EngineerSalary: £40K - £50KLocation: ManchesterRole Overview: Our client is seeking a Data Engineer to support the development, optimisation and ongoing improvement of a modern cloud-based data platform.This role would suit someone with strong hands-on Databricks experience who enjoys building reliable data pipelines, improving how data flows through the business, and creating trusted datasets for reporting and analytics.You will work across technical and non-technical teams, helping turn data requirements into scalable solutions that are accurate, maintainable and easy for the business to use.Key Responsibilities:Build, enhance and maintain data pipelines within a Databricks environment.Use Spark, SQL and Python or Scala to support data transformation and automation.Develop structured data layers to support reporting, analytics and wider business use.Extract, ingest and integrate data from APIs, databases and other source systems.Build controls that help identify, investigate and resolve data issues before they affect reporting.Monitor data workflows and troubleshoot failures, performance issues and reliability problems.Work with BI and reporting teams to create clean, usable datasets for business consumption.Maintain clear technical documentation and support good practice around data structure, ownership and access.Support secure and appropriate use of data across the platform. Identify opportunities to simplify, automate and improve data engineering ..... full job details .....