Data Engineer

Data Engineer - Data Pipelines - Python - SQL - 4 months - inside IR35 - London Hybrid - SC ClearanceI am working with a government department in Central London who are urgently looking for an experienced Data Engineer to help with improving their team''s data infrastructure.You will be reviewing current pipelines, streamlining data ingestion from source systems, and embedding robust automation using the organisation''s Analytical Platform. There is a strong focus on removing manual processes, enhancing data quality, and enabling faster insight generation.Due to the urgency of the role and the work involved, candidates with active SC clearance would be preferred.I am therefore keen to speak with candidates who haveAdvanced experience in data pipeline development using cloud-native toolsProficient in Python and SQL for data transformation and manipulationHands-on experience with dbt and a strong grasp of data modelling conceptsComfortable with orchestration tools such as Airflow (or similar)Familiarity with AWS infrastructure, especially Glue and S3Skilled in version control and CI/CD workflows (eg Git, GitHub Actions)Able to work autonomously, taking ownership of deliverables from concept to completionConfident working across stakeholder groups to gather requirements and iterate solutionsStrong user-centred mindset with a commitment to continuous improvementOpen to exploring innovative tooling and AI-assisted workflowsExperience with Amazon Quicksight would also be an ..... full job details .....