https://jobs.co.uk/job/datastreaming-engineer-if-recruitment-ltd--004c59d0-71ff-46fb-9a9b-bcda1bf37904 RSS feed for Data/Streaming Engineer at IF Recruitment Ltd. en-gb Mon, 28 Sep 2026 14:45:52 GMT https://jobs.co.uk/job/datastreaming-engineer-if-recruitment-ltd--004c59d0-71ff-46fb-9a9b-bcda1bf37904 https://jobs.co.uk/job/datastreaming-engineer-if-recruitment-ltd--004c59d0-71ff-46fb-9a9b-bcda1bf37904 Mon, 28 Sep 2026 11:53:01 GMT Location: Luton | Salary: 10000-500000 Annual | Type: Any | Role purpose Build reliable capability on the existing enterprise data platform and Databricks estate, then evolve towards lower-latency, event-driven processing where the use case justifies it. Responsibilities: Build and operate batch, micro-batch and streaming ingestion/processing pipelines. Work pragmatically with existing Databricks/Spark capability while introducing lower-latency event patterns progressively. Design schemas, data contracts and evolution strategies between independently changing systems. Build for replay, idempotency, ordering, failure recovery, monitoring and operational support. Integrate data/event capability with application services and predictive/ML components. Own data quality, observability, CI/CD and production reliability. Skills/Experience Required: Real production streaming/event-driven experience with Kafka, Azure Event Hubs or comparable technology. Can explain partitions, consumer groups, ordering, delivery semantics, replay, idempotency, schema evolution, failure recovery, monitoring and performance from lived production experience. Strong hands-on Python and distributed data-processing capability; Spark/Databricks strongly useful. Productio... Any