Data Engineer

Senior Data Engineer (Contract) Duration: 6 Months (Possibility for extension)Location: London/Hybrid (3 days per week on site) Rate: A highly competitive Umbrella Day Rate is available for suitable candidates Role ProfileWe are seeking a highly skilled Senior Data Engineer with strong expertise in Python and Databricks to design, build, and optimise scalable data pipelines and platforms. You will play a key role in enabling data-driven decision-making by delivering reliable, efficient, and high-quality data solutions. Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using Python and DatabricksBuild and optimise ETL/ELT workflows leveraging Databricks (Spark, Delta Lake)Develop robust data models and data architectures on Lakehouse platformsImplement and manage data workflows within the Databricks ecosystemEnsure high data quality, governance, and reliability across pipelinesOptimise performance of large-scale distributed data processingCollaborate with data scientists and analysts to support analytics and MLImplement monitoring, logging, and alerting for data systemsMentor junior engineers and drive engineering best practices Skills and ExperienceExtensive experience in data engineeringStrong programming expertise in PythonHands-on experience with Databricks (workflows, notebooks, jobs, Delta Lake)Strong experience with Apache Spark / PySparkExperience building scalable ETL pipelinesProficiency in SQL and relational databasesExperience with cloud ..... full job details .....