Junior Data Engineer

As a Junior Data Engineer within the Production team, you will play a critical role in the swift, accurate, and secure progression of client jobs. You will be responsible for ensuring the reliability of data outputs, standardising external data, and driving process improvements that enhance our overall efficiency.This role bridges technical execution with operational excellence, requiring a proactive individual who is detail-driven, process-orientated, and eager to grow their skills within AWS and Databricks. You will work closely with Account Managers, Sales, and cross-functional teams to deliver high-quality data solutions that meet our clients'' needs.Key ResponsibilitiesData Processing and AccuracyEnsure the swift, accurate, and secure progression of client jobs, performing bespoke file matches, standardisation, enhancement, and deduplication of external data.Ensure the highest standards of data accuracy and reliability in all outputs, actively monitoring for discrepancies to reduce errors and rework over time.Maintain strict adherence to security, confidentiality, and data compliance protocols in all data handling.Technical Execution and Process ImprovementPerform ad-hoc queries, counts, and data manipulation using Databricks, SQL, and FastStats.Identify, propose, and implement process improvements to enhance productivity, accuracy, and the overall efficiency of the Production team.Develop and maintain robust ETL (Extract, Transform, Load) logic tailored to production ..... full job details .....