Senior Data Engineer

Senior Data Engineer - Market Data We are looking for a Senior Data Engineer to build and operate a high-performance market data platform supporting quantitative research and production trading systems. You''ll design scalable data pipelines, process billions of market data records, and deliver reliable, production-quality datasets for research, analytics and real-time applications. Key Responsibilities Build scalable ETL/ELT pipelines for batch and streaming market data. Develop production-grade Python and SQL solutions. Ingest, normalise and validate market data, including trades, ticks, Level 1 and 2 quotes, order books, reference data and corporate actions. Implement automated data quality, reconciliation and monitoring frameworks. Optimise data storage using Parquet, Arrow and modern data lake technologies. Partner with quantitative researchers, traders and engineering teams to deliver trusted datasets. Essential Skills Strong Python and SQL. Experience building scalable, production data pipelines. Expertise with Parquet and modern data storage formats. Deep understanding of high-frequency market data, including tick data, order books and market data normalisation. Experience handling time-series challenges such as timestamp precision, sequence gaps, duplicate and out-of-order events. Experience with distributed processing (Spark, Polars, Dask, Ray or similar). Experience with Kafka or similar streaming technologies. Familiarity with PostgreSQL, ClickHouse, ..... full job details .....