Hadoop Platform Engineer

Location: Edinburgh or London (1-2 days per week on-site)
Contract- day rate

6 Month Contract

Our UK leading banking client is undergoing a major enterprise data transformation, and we're looking for a skilled Hadoop Platform Engineer to help shape and evolve the future of our data ecosystem. If you're passionate about data engineering at scale, modernisation, and cloud migration, this is a unique opportunity to work at the heart of one of the UK's largest financial institutions.

The Role

As a Hadoop Platform Engineer, you'll play a key role in supporting, maintaining, and modernising our on-premise HDFS-based Data Lake and associated Hadoop ecosystem components. You will also help drive the strategic migration of our Hadoop workloads to the cloud, contributing to enterprise-wide simplification and transformation initiatives.

You'll work across our data engineering community, ensuring our platforms remain robust, secure, and high-performing as we transition to the next generation of data capabilities.

What You'll Be Doing

• Managing and maintaining large-scale Hadoop clusters across on-prem environments
• Supporting and optimising our HDFS-based Data Lake and adjacent platform components
• Working with technologies including Hadoop, Spark, HDFS, YARN, Hive, Oozie, and related tooling
• Partnering with engineering teams to deliver scalable, high-quality data solutions
• Contributing to our cloud migration strategy, helping move Legacy workloads into modern cloud platforms
• Driving platform simplification and engineering excellence across distributed systems
• Supporting enterprise data transformation activities that enable the bank's strategic objectives
• Ensuring stability, performance, and security of critical data services

What We're Looking For

• Strong hands-on experience with Hadoop ecosystem tools (HDFS, Spark, Hive, Oozie, YARN, etc.)
• Experience operating and supporting large, complex, distributed clusters
• Understanding of data engineering principles and data platform design
• Experience with on-prem Hadoop environments and ideally cloud-based data platforms
• Exposure to cloud technologies (AWS, Azure, or GCP)
• Ability to troubleshoot complex platform issues across networking, compute, and storage layers
• A proactive mindset and desire to contribute to large-scale transformation work
• Open to applicants from a variety of industries and backgrounds

Guidant, Carbon60, Lorien & SRG - The Impellam Group Portfolio are acting as an Employment Business in relation to this vacancy.