SC cleared Junior Data Engineer

Junior Data EngineerLocation: Mainly remote, with occasional meetings in LondonRate: Up to £395 per dayClearance: SC cleared preferred - must be eligible for SCSector: Central GovernmentType: ContractThe RoleWe''re looking for a Junior Data Engineer to join a long-term central government data programme.This is a hands-on role supporting the movement, transformation and processing of operational data into a large-scale data platform.You''ll work as part of an established engineering team, building and maintaining data pipelines and supporting data solutions in production.Key ResponsibilitiesBuild and maintain data pipelinesSupport data ingestion, transformation and processingWork with large and complex datasetsDevelop solutions using Python and/or JavaUse SQL to query, manipulate and transform dataWork with cloud-based data platformsTroubleshoot pipeline and data issuesSupport solutions through development and into productionCollaborate with engineers and technical teams across the programmeSkills andamp; ExperienceCommercial Data Engineering or data-focused software engineering experiencePython and/or JavaStrong SQL skillsExperience building or maintaining data pipelinesExperience with cloud-based data platformsGood understanding of production engineering environmentsExperience with any of the following would be beneficial:AWS, Kafka, Kubernetes, Spark, Glue, Athena, Redshift, S3 or Lake Formation.You don''t need experience with every technology listed. We''re looking for ..... full job details .....