Senior Data Engineer

Senior Data EngineerLocation: BristolContract: Outside IR35Rate: £68 per hourSecurity Clearance: DV ClearedWorking Pattern: 5 Days On SiteNationality Requirement: Sole British Nationals OnlyTHE ROLEWe are recruiting on behalf of a highly secure engineering and technology programme seeking an experienced Senior Data Engineer to support the design, development and delivery of secure, scalable and high-performance data solutions within a regulated environment.This role will focus heavily on the Elastic Stack and Apache NiFi, supporting enterprise-scale data ingestion, transformation and analytics capabilities across complex secure systems.The successful candidate will play a key role in architecting resilient data platforms, optimising real-time and batch processing pipelines, and ensuring compliance with strict governance and security standards.KEY RESPONSIBILITIESData Architecture and Engineering- Design and implement scalable, resilient data pipeline architectures using Elastic Stack and Apache NiFi- Develop secure frameworks for data ingestion, transformation and integration- Build and maintain batch and real-time data processing pipelines- Ensure high standards of data quality, integrity and traceability across all systemsElastic Stack and Platform Management- Configure, optimise and maintain Elasticsearch clusters for performance and resilience- Develop and maintain Logstash pipelines for efficient data processing- Create dashboards and visualisations within Kibana to ..... full job details .....