img
Permanent

Senior Data Engineer and Platform Lead - Morgan Advanced Materials - Remote

City of London
money-bag Negotiable
Posted 2 days ago

OverviewTake ownership of the Azure-hosted analytical platform, ensuring it meets current and future business requirements. Optimize the platform for performance, security, and scalability, ensuring alignment with best practices. Design and develop scalable ETL pipelines and data solutions using Azure Data Factory, Synapse Analytics, and related tools. Work closely with stakeholders to understand business needs and translate them into actionable data solutions. Lead and mentor the Data and Analytics team, ensuring the smooth operation of data pipelines and alignment with organizational objectives.

Responsibilities

Team Leadership and Coordination : Provide technical guidance and mentorship to the Data and Analytics team. Oversee the team\''s Agile processes including sprints, prioritisation, and issue resolution. Define best practices for data pipeline design, development, and maintenance. Coordinate with the solution architect to ensure platform architecture meets current and future requirements. Act as a point of escalation for complex data engineering challenges.

Data Engineering : Design, build, and maintain data pipelines for seamless integration of ERP and other critical data sources into Azure Synapse. Ensure data workflows are optimized for performance, scalability, and reliability. Lead efforts to standardize ETL/ELT processes and enforce data quality standards across the platform. Implement data transformation logic to create clean, usable datasets for reporting and analytics.

Platform Administration and Optimization : Monitor and optimize Azure Synapse Analytics performance, ensuring cost efficiency and resource utilization. Implement monitoring and alerting for pipeline performance, failures, and resource consumption. Suggest and implement automation for repetitive tasks using tools like Azure Logic Apps, Power Automate, or custom scripting. Collaborate with the Data Governance Lead to ensure compliance with governance and security standards.

Business and Stakeholder Collaboration : Work closely with business units to understand data requirements and ensure outputs align with business needs. Validate that datasets and reports delivered by Power BI developers meet performance and usability standards. Support data-driven decision-making by ensuring high-quality and accessible data across the organization.

Innovation and Strategy : Stay updated on advancements in Azure, Synapse, data engineering tools and other relevant technologies to recommend and implement improvements. Identify opportunities to leverage advanced data processing techniques (e.g., big data, real-time processing) and AI. Contribute to the long-term strategy for the GDP, including scaling the platform for future needs.

Required and Preferred Qualifications

Leadership: Experience managing and mentoring data engineers or technical teams.

Technical Expertise: Advanced knowledge of Azure Synapse Analytics, Azure Data Factory, and SQL.

Proficiency in ETL/ELT pipeline design and optimization.

Familiarity with automation tools (Azure Logic Apps, Power Automate, Python, or PowerShell scripting).

Knowledge of cloud performance optimization and cost management.

Collaboration: Strong ability to work cross-functionally with technical teams, governance leads, and business stakeholders.

Analytical Thinking: Ability to design efficient, scalable, and high-performing data workflows.

Strategy and planning: Experience with definition of data strategy, global data platform strategy and development roadmaps aligned with company\''s digital transformation plans.

Governance Awareness: Understanding of data governance principles and ability to work within established frameworks.

Education: Bachelor or Master degree in a related field of study.

Experience: 5+ years in data engineering, with a strong focus on Azure cloud services across a mixture of Enterprise and SME environments.

Technical Skills: Proficiency in Python, SQL, Azure Data Factory, Azure Synapse Analytics, Azure Data Lakes, and big data technologies like Apache Spark.

DevOps: Experience with DevOps practices and CI/CD pipelines in an Azure environment is a plus.

Certifications: Certification in Azure (e.g., Microsoft Certified: Azure Data Engineer Associate) is highly desirable.

Soft Skills: Excellent problem-solving abilities, strong communication skills, ability to work collaboratively in a team environment, and a keen attention to detail. Fully up to speed with Agile development methodologies e.g., DevOps, Scrum (EPICs, Stories, Task, Issues, Bugs). Excellent analytical and problem-solving skills and the ability to troubleshoot complex issues. Excellent stakeholder management, communication and interpersonal skills. Ability to thrive in a fast-paced and collaborative environment. Detail-oriented and well-organized.

About Morgan Advanced MaterialsMorgan Advanced Materials is an EEO/AA/M/W/D/V Employer Ind-1. Morgan is a world leader in the development and production of advanced materials. We produce a wide range of specialist, high specification materials that have extraordinary attributes and properties. Our focus is simple - we supply innovative, differentiated products made from advanced materials that enable our customers\'' products to perform more efficiently, more reliably and for longer.

OpportunityMorgan is making a significant investment in establishing a world-class global data team, and we are excited to welcome new employees who will play a crucial role in this initiative. You will be instrumental in building the future data platform that will drive the success of our enterprise. Your contributions will shape the foundation of our data capabilities and help position Morgan as a leader in leveraging data to achieve strategic business goals. This is a unique opportunity to be part of a transformative journey, where your efforts will directly impact the future growth and innovation of the ..... full job details .....

Other jobs of interest...

CV-Library
LondonToday
money-bag£38000 - £45000/annum
CV-Library
LondonToday
money-bag£125000/annum
Get Staffed Online Recruitment
South West LondonToday
money-bag£75,000
Engelhart CTP Group
LondonToday
money-bagNegotiable

Perform a fresh search...

  • Create your ideal job search criteria by
    completing our quick and simple form and
    receive daily job alerts tailored to you!

Jobs. Straight to your inbox!