Senior Data Engineer | Python | Azure Data Factory | Kafka | PostgreSQL | Elasticsearch |

Senior Data Engineer Ledbury/Malvern/Gloucester/Cheltenham AreaOn-site - 5 Days Per WeekUp to £85,000 + BenefitsSecurity Clearance: Active SC Clearance Required Methods Business and Digital Technology is a £100M+ IT Services Consultancy delivering complex digital transformation programmes across government and regulated sectors. We are seeking an experienced Senior Data Engineer to join a growing team supporting the delivery of secure, mission-critical data platforms. This role requires an individual who is comfortable operating across hybrid environments, combining on-premises infrastructure with Azure cloud technologies to deliver scalable, secure and high-performing data solutions. The Role: As a Senior Data Engineer, you will design, build and maintain sophisticated data infrastructure supporting analytics, reporting and operational decision-making. You will work across the full data life cycle, developing robust data pipelines, implementing automation and supporting Real Time data streaming capabilities. Responsibilities: Design, develop and maintain scalable data pipelines using Python, Go and Azure Data Factory Develop ETL and ELT processes supporting structured, semi-structured and unstructured data Implement and manage hybrid data solutions across on-premises and Azure environments Build and maintain PostgreSQL database solutions Manage Elasticsearch deployments and optimisation Implement workflow automation using Azure Data Factory Develop and support Real Time ..... full job details .....