Data Engineer

Data EngineerPython AWS DatabricksWe''re working with a leading organisation operating at the forefront of the energy sector, playing a critical role in supporting the transition to a more sustainable, low-carbon future.As the business continues to invest in its data capabilities, they are looking for a Data Engineer to join their growing Data Platform team. This is an opportunity to work in a complex, evolving environment where data is central to decision-making across trading, operations, and commercial functions.The RoleYou''ll be responsible for building and maintaining scalable data pipelines that power analytics and reporting across the organisation. Working within a modern Databricks on AWS environment, you''ll help deliver reliable, high-quality data to support business insights.Key ResponsibilitiesBuild and maintain scalable ETL/ELT pipelines using Python and PySparkIngest and integrate data from multiple sources including trading, finance, and operational systemsWork within a Databricks Lakehouse architecture to transform and deliver dataOptimise Spark jobs for performance and cost efficiencyImplement and maintain data quality, governance, and reliability standardsSupport the full data lifecycle from ingestion through to reporting and insight deliveryCollaborate with BI teams and stakeholders to ensure data is accessible and usableKey Skills and ExperienceStrong experience in Data Engineering (3-6 years)Proficiency in Python and PySpark for large-scale data ..... full job details .....