img
Permanent

Mid/Senior Data Engineer

Sheffield
money-bag Negotiable
Posted Yesterday

Overview

Methods Analytics (MA) is recruiting for a Data Engineer to join our team on a permanent basis. This role will be mainly remote but require flexibility to travel to client sites, and our offices based in London, Sheffield, and Bristol.What You''ll Be Doing as a Data Engineer

Lead technical aspects of data engineering projects, providing direction and mentorship to junior and mid-level engineersDesign and architect modern data solutions that align with business objectives and technical requirementsDesign and implement advanced ETL/ELT pipelinesBuild highly scalable and performant data solutions leveraging cloud platforms and open-source softwareDevelop data models to handle enterprise-level analytical needsMake critical technical decisions on tools, frameworks, and approaches for complex data challengesOptimise large-scale data processing systems for performance and cost-efficiencyImplement robust data quality frameworks and monitoring solutionsEvaluate new technologies to enhance our data engineering capabilitiesCollaborate with stakeholders to translate business requirements into technical specificationsPresent technical solutions to leadership and non-technical stakeholdersContribute to the development of the Methods Analytics Engineering Practice by participating in our internal community of practiceYour Impact

Enable business leaders to make informed decisions with timely, accurate data insightsDrive adoption of modern data architectures and platformsDeliver seamless data solutions that enhance user experienceElevate the technical capabilities of the entire data engineering teamHelp cultivate a data-driven culture within the organisationEstablish technical standards and patterns that ensure quality and maintainabilityRequirements

You Will Demonstrate

Proven experience leading technical aspects of data projectsStrong data architecture and modelling skills with the ability to design scalable data solutionsExperience mentoring junior engineers and providing technical guidanceDeep understanding of data warehouse design principles and methodologiesAdvanced knowledge of optimisation techniques for large-scale data processingStrong proficiency in SQL and Python for handling complex data problemsHands-on experience with Apache Spark (PySpark or Spark SQL)Experience with the Azure data stackKnowledge of workflow orchestration tools like Azure Data Factory or Apache AirflowExperience with containerisation technologies like DockerProficiency in dimensional modelling techniquesExperience with CI/CD pipelines for data solutionsExperience implementing and advocating for test-driven development methodologies in data pipeline workflows, including unit testing, integration testing, and data quality validation frameworksStrong communication skills for translating complex technical conceptsTrack record of successful project delivery in a technical leadership capacityDesirable Skills

Experience designing and implementing data mesh or data fabric architecturesKnowledge of cost optimisation strategies for cloud data platformsExperience with data quality frameworks and implementationUnderstanding of data lineage and metadata managementExperience with technical project managementExperience with data visualization tools like Power BI or Apache SupersetExperience with other cloud data platforms like AWS, GCP or OracleExperience with modern unified data platforms like Databricks or Microsoft FabricExperience with Kubernetes for container orchestrationUnderstanding of streaming technologies (Apache Kafka, event-based architectures)Software engineering background with SOLID principles understandingExperience with high-performance, large-scale data systemsKnowledge of recent innovations in AI/ML and GenAIDefence/Public Sector consultant experienceSecurity Clearance

UKSV (United Kingdom Security Vetting) clearance is required for this role, with Security Check (SC) as the minimum standard, either already held or with a willingness to undergo the process. Some roles/projects may require Developed Vetting (DV) clearance; while not mandatory, a willingness to obtain DV clearance would be beneficial. As part of the onboarding process candidates will be asked to complete a Baseline Personnel Security Standard (BPSS); details of the evidence required to apply may be found on GOV.UK – Government baseline personnel security standard. If you are unable to meet this and any associated criteria, then your employment may be delayed, or rejected. Details of this will be discussed with you at interview.Hiring Process

Internal Application ReviewInitial Phone ScreenTechnical InterviewPair Programming ExerciseFinal InterviewOfferBenefits

Working at MA

Methods Analytics (MA) exists to improve society by helping people make better decisions with data. We use a collaborative, creative and user-centric approach to data and value discussion, ethics, privacy and quality. We offer a supportive and collaborative environment with opportunities for growth and development.Autonomy to develop and grow your skills and experienceBe part of exciting project work that is making a difference in societyStrong, inspiring, and thought-provoking leadershipA supportive and collaborative environmentAnnual two-day technical hackathonMonthly Engineering and Architecture Community of PracticeBi-annual whole company teambuilding eventsDevelopment access to Pluralsight and LinkedIn LearningVolunteering - 2 paid days per yearPrivate Medical Insurance for you and dependentsWorldwide Travel Insurance for you and dependentsDiscretionary Company BonusLife Assurance of 4x base salary25 days annual leave + bank holidays, with option to buy 5 extra daysPension Salary Exchange SchemeWellness 24/7 confidential employee assistanceSocial events and charitable involvementSeniority level

Mid-Senior levelEmployment type

Full-timeJob function

Information TechnologyIndustries

IT Services and IT ConsultingReferrals increase your chances of interviewing at Methods by ..... full job details .....

Other jobs of interest...

JR United Kingdom
ChesterfieldYesterday
money-bagNegotiable
JR United Kingdom
SheffieldYesterday
money-bagNegotiable
CV-Library
Sheffield
money-bag£50000 - £70000/annum
JR United Kingdom
Sheffield
money-bagNegotiable

Perform a fresh search...

  • Create your ideal job search criteria by
    completing our quick and simple form and
    receive daily job alerts tailored to you!

Jobs. Straight to your inbox!