Lead Data Engineer

Data Engineer We''re supporting a leading enterprise financial services organisation in the search for an experienced Data Engineer to join a high-performing data team on an initial 6-month contract. Contract Details: Inside IR35 Initial 6-month engagement Sheffield-based, 3 days per week on-site Key Requirements: Strong hands-on experience with PySpark and Databricks Deep understanding of Spark performance optimisation, including lazy evaluation, column pruning, groupBy operations, and window functions Proven ability to troubleshoot and resolve Spark job performance issues Extensive experience designing, developing, and supporting enterprise-scale data pipelines Strong technical depth across modern data engineering platforms, tools, and technologies Experience working within complex, large-scale enterprise environments This is an excellent opportunity to contribute to a major data transformation programme within a leading financial services organisation. Additional information available on successful application. ..... full job details .....