Senior Data Engineer - PySpark/Databricks/Airflow

Senior Data Engineer - PySpark/Databricks/Airflow Location: LondonSalary: Up to £140,000 basicWorking Arrangement: 5 days per week in the office An established specialist insurance business is looking for a Senior Data Engineer to join its growing analytics and data engineering function. This is an opportunity to take ownership of data engineering projects across a modern analytics platform, building scalable data pipelines and delivering high-quality data products that support actuarial analysis, portfolio reporting and wider business decision-making. Working closely with the Lead Data Engineer and business stakeholders, you will play a key role in developing the data platform, improving existing processes and translating business requirements into effective technical solutions. Key Responsibilities Design, build and maintain scalable data pipelines and data products. Use PySpark and modern data engineering technologies to transform raw data into reliable, analysis-ready datasets. Develop and improve data orchestration and transformation processes. Work directly with business stakeholders to understand requirements and deliver practical technical solutions. Support the ongoing development, maintenance and optimisation of the existing data platform. Implement automated data quality checks, monitoring and best practices. Identify opportunities to improve performance, scalability and efficiency across the platform. Work collaboratively with engineering, ..... full job details .....