7 data engineer jobs found

Date Opened 29/04/2026 Job Type Contract Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and user-centred digital solutions that create real impact. Active SC clearance is a mandatory, non-negotiable requirement. Candidates must hold...

Date Opened 28/04/2026 Job Type Contract Job Description About Scrumconnect Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. Role Overview We are seeking an experienced  Senior Data Engineer  to develop, maintain, and...

The Department for Work and Pensions (DWP) is responsible for welfare, pensions, and child maintenance policy. As the UK's biggest public service department, it administers the State Pension and a range of working age, disability and ill health benefits to around 20 million claimants and customers. As such, we operate on a scale that is almost unmatched anywhere in Europe and most people in Britain come into contact with us at some point in their lives.   Working with DWP, you will be helping us to drive our priorities to:   Help people to move into work and support those already in work to progress, with the aim of increasing overall workforce participation Help people to plan and save for later life, while providing a safety net for those who need it now Provide effective, efficient, and innovative services to the millions of claimants who rely on us every day, including the most vulnerable in society Improve experience of our services while...

Location: Remote with occasional travel to Newcastle Work Pattern: Predominantly remote Duration: 6 months + extension Clearance Requirement: Active SC Clearance Rate: £510 per day Inside IR35 SFIA Level: SFIA 4 Overview We are seeking an experienced SC Cleared Data Engineer to support the design, build, and optimisation of secure, scalable cloud-based data platforms within a complex public sector environment. This role is ideal for a hands-on engineer with strong AWS data engineering experience, supported by solid knowledge of Terraform, Kafka, Python, and modern big data tooling such as Databricks. Exposure to EMR would be advantageous, and Java is considered a nice to have. You will work as part of a collaborative delivery team, helping to build robust data pipelines and cloud-native data services that enable reliable, secure, and high-quality data processing. Essential Skills: Strong commercial experience working as a Data Engineer within...

Date Opened 28/04/2026 Job Type Contract Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful and innovative technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. We are passionate about user-centred design, agile delivery, and building digital services that make a real difference. Our teams work at the forefront of innovation, helping organisations transform and deliver high-quality, scalable solutions that truly matter.   Overview: We are looking for a highly skilled AWS DevOps / Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks. ...

Date Opened 15/04/2026 Job Type Contract About Scrumconnect Scrumconnect Consulting is a UK-based digital transformation consultancy delivering agile, secure technology solutions for public and private sector clients. This is a fully remote role based in India, supporting our UK operations and client base. You will work closely with our UK leadership team and must be comfortable operating within UK regulatory and legal frameworks. About the role You will join a data engineering team responsible for building and maintaining a large-scale, longitudinal data asset that draws on multiple source systems and channels. The pipeline extracts, transforms, and loads data into a trusted analytical resource accessed by a broad community of data users and analysts. Key responsibilities Pipeline development Design, build, and maintain ETL/ELT data pipelines that extract from multiple sources, apply transformations, and load into a governed analytical...

Date Opened 15/04/2026 Job Type Contract About Scrumconnect   Scrumconnect Consulting is a UK national SME award-winning software development consultancy with over 300 consultants across the UK. We work with UK Public Sector clients to build impactful, award-winning digital services that improve millions of lives.   We take as much pride in our people, culture and work-life balance as we do in making services that improve millions of lives. Collaborative, entrepreneurial and dedicated to problem-solving, we bring the step change our customers need to sustain innovation.     About the role   You will work as a forward deployed engineer embedded within a security-focused capability unit, designing, building, and deploying AI-powered tools that drive measurable improvements in cyber security and fraud prevention. Working closely with technical teams and operational stakeholders, you will turn requirements into...