Data Engineer

We are looking for a skilled and experienced Backend Developer with a strong background in data engineering for an exciting 6-month contract role with a global financial services client based in Canary Wharf. This position offers a daily rate of -700 via an umbrella company.

The Role

You will be responsible for building and maintaining the data pipeline that feeds data from various sources, including Snowflake, PostgreSQL, and Kafka topics, into a real-time visualisation platform. You will work closely with frontend developers to ensure data is accurately processed, transformed, and available for visualisation.

Key responsibilities include:

• Designing and implementing scalable data pipelines for real-time data processing and visualisation.
• Integrating data from sources such as Snowflake, PostgreSQL databases, and Kafka topics.
• Performing data transformations to structure and optimise data for visualisation.
• Developing APIs to expose data for the frontend application, with a focus on GraphQL, and designing RESTful APIs and remote procedure calling.
• Implementing robust authentication mechanisms to secure data access for external customers.
• Collaborating with frontend developers to ensure seamless integration within a microfrontend architecture.
• Monitoring and optimising the performance of data pipelines and backend services.
• Ensuring data quality and integrity throughout the pipeline.

Skills and Experience

• The ideal candidate will have proven experience as a Backend Developer or Data Engineer and a strong understanding of authentication protocols and security best practices.
• Strong programming skills in Node.js/TypeScript and Java.
• Experience with Azure.
• Expertise in designing RESTful APIs, GraphQL, and remote procedure calling.
• Experience with microservices architecture.
• Familiarity with database technologies like Snowflake and PostgreSQL.
• Knowledge of Apache Kafka and real-time data streaming platforms.
• Experience with data transformation techniques and ETL processes.

How to Apply

If you are a talented Backend Developer with the required skills and are available for a 6-month contract, please submit your application with your resume.

Randstad Technologies is acting as an Employment Business in relation to this vacancy.