49 data engineer jobs found in Newcastle upon Tyne

Date Opened 29/04/2026 Job Type Contract Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and user-centred digital solutions that create real impact. Active SC clearance is a mandatory, non-negotiable requirement. Candidates must hold...

Date Opened 28/04/2026 Job Type Contract Job Description About Scrumconnect Scrumconnect is a leading force in technology consultancy, proudly contributing to over 20% of the UK’s most significant citizen-facing public services. Our award-winning team has made a substantial impact, delivering more than 64 services in the past two years alone. This work has not only reached over 50 million citizens but also achieved considerable savings for the taxpayer, amounting to over £25 million. At Scrumconnect, we foster a community of talented consultants who thrive on collaboration, sharing knowledge, and continuous learning to address and solve complex challenges. Our mission is to combine advanced software engineering, human-focused design, and data-driven insights to deliver unparalleled service to our clients. Role Overview We are seeking an experienced  Senior Data Engineer  to develop, maintain, and...

The Department for Work and Pensions (DWP) is responsible for welfare, pensions, and child maintenance policy. As the UK's biggest public service department, it administers the State Pension and a range of working age, disability and ill health benefits to around 20 million claimants and customers. As such, we operate on a scale that is almost unmatched anywhere in Europe and most people in Britain come into contact with us at some point in their lives.   Working with DWP, you will be helping us to drive our priorities to:   Help people to move into work and support those already in work to progress, with the aim of increasing overall workforce participation Help people to plan and save for later life, while providing a safety net for those who need it now Provide effective, efficient, and innovative services to the millions of claimants who rely on us every day, including the most vulnerable in society Improve experience of our services while...

Location: Remote with occasional travel to Newcastle Work Pattern: Predominantly remote Duration: 6 months + extension Clearance Requirement: Active SC Clearance Rate: £510 per day Inside IR35 SFIA Level: SFIA 4 Overview We are seeking an experienced SC Cleared Data Engineer to support the design, build, and optimisation of secure, scalable cloud-based data platforms within a complex public sector environment. This role is ideal for a hands-on engineer with strong AWS data engineering experience, supported by solid knowledge of Terraform, Kafka, Python, and modern big data tooling such as Databricks. Exposure to EMR would be advantageous, and Java is considered a nice to have. You will work as part of a collaborative delivery team, helping to build robust data pipelines and cloud-native data services that enable reliable, secure, and high-quality data processing. Essential Skills: Strong commercial experience working as a Data Engineer within...

Company Description   Lookthru specialises in process automation, data warehousing, data analytics and visualisation to drive exceptional ROI for clients, including startups and enterprises.   Our expertise lies in creating visually compelling dashboards, reducing manual dependencies and developing modern, scalable solutions for data optimisation. We help businesses identify valuable data, streamline processing from multiple sources, and simplify decision-making. Leveraging cloud platforms like Azure and AWS, we deliver tailored data strategies, automated pipelines, and seamless access to critical information for long-term value creation.   Role Description   This is a contract-based remote position for a Data Engineer. The candidate must be based within the UK. The Data Engineer will design, build, and optimise ETL pipelines, develop data models, manage data warehousing solutions and analyse data to support business decisions....

Note: SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position, (and speed at which we require a postholder in situ), preference may be given to candidates who meet all of the essential criteria and hold active security clearance   Data Engineers are responsible for the creation and maintenance of analytics infrastructure, providing the foundations for data needs. Data Engineers are responsible for developing, constructing, maintenance and testing of architectures, such as databases and large-scale processing systems, implementing data flows to connect operational systems, and writing and executing ETL scripts and codes.   As a SAS Data Engineer, you are responsible for developing accurate, efficient data solutions which meet customer needs to agreed timescales. You ensure the stability, robustness and resilience of the...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+ years...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+ years...

EXL (NASDAQ: EXLS) is a global data and artificial intelligence (AI) company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect.   We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com.   Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+ years...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+ years...

CCaaS Data Analytics Engineer Duration: 18 month contract - approximately May 2026 to Oct 2027 Location: Any HMRC Regional Centre - Hybrid Role Description and Responsibilities HMRC is delivering an enterprisewide OmniChannel Contact Centre as a Service capability. Previous implementations of customer contact services were delivered across disparate platforms, resulting in fragmented data sources and significant complexity in extracting, structuring, and consuming contact centre data across the wider organisation. This role exists to address that challenge directly. The CCaaS Data Analytics Engineer will provide specialist expertise focused on how customer contact data is extracted, structured, accessed, and used across the organisation. While the role will engage closely with CCaaS platforms, its primary focus is on influencing the design and build of enterprise data solutions that consume CCaaS data, ensuring that data is accessible,...

Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot - that's how we refer to this role at Mindrift - you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer, you 'll handle data scraping tasks requiring technical...

Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot - that's how we refer to this role at Mindrift - you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe. About the Role This is a freelance role for a Tendem project. As a Python Data Scraping Engineer, you 'll handle data scraping tasks requiring technical precision for web...

Date Opened 28/04/2026 Job Type Contract Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful and innovative technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. We are passionate about user-centred design, agile delivery, and building digital services that make a real difference. Our teams work at the forefront of innovation, helping organisations transform and deliver high-quality, scalable solutions that truly matter.   Overview: We are looking for a highly skilled AWS DevOps / Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps expertise combined with data engineering capabilities, working across modern cloud technologies and automation frameworks. ...

Who We Are CreateFuture is fast becoming the UK’s most recognisable digital consultancy, with years of experience building digital products and services for major organisations whilst putting our people first. We have offices in the centre of Edinburgh, Leeds, Manchester, and London as well as remote employees located throughout the country. We are a team of creators - whether that’s code, project plans, go to market strategies, culture initiatives, marketing campaigns, large language models or people policies. And together, with our clients, we create the future. This has seen us collaborate and partner across a multitude of industries and sectors, with the likes of PayPal, adidas, Natwest, FanDuel and Money Saving Expert, to name just a few. Our reputation as a partner determined to deliver high-quality, robust and thoughtful products has enabled us to scale to over 500 people in the last couple of years, and it is our amazing people - along with the safe,...

Who we are CreateFuture is fast becoming the UK’s most recognisable digital consultancy, with years of experience building digital products and services for major organisations whilst putting our people first. We have offices in the centre of Edinburgh, Leeds, Manchester, and London as well as remote employees located throughout the country.    We are a team of creators - whether that’s code, project plans, go to market strategies, culture initiatives, marketing campaigns, large language models or people policies. And together, with our clients, we create the future. This has seen us collaborate and partner across a multitude of industries and sectors, with the likes of PayPal, adidas, Natwest, FanDuel and Money Saving Expert, to name just a few.   Our reputation as a partner determined to deliver high-quality, robust and thoughtful products has enabled us to scale to over 500 people in the last couple of years, and it is our amazing...

Devops Engineer £712.19 per day (Inside IR35) 9 months 1-2 days a week Preston   Applies deep technical expertise in infrastructure automation, environment provisioning, and deployment pipelines supporting the EDP platform and its AI/ML workloads. Designs, maintains, and supports the CI/CD pipelines using GitLab CI, enabling frequent, reliable deployments to Azure Kubernetes Service (AKS). Manages containerisation using Docker, builds and publishes container images to registries, and ensures secure and efficient AKS cluster deployments. Implements infrastructure as code using Terraform, including network, security, and compute resources. Supports Airflow as part of platform orchestration. Collaborates closely with Data Engineers, MLOps Engineers, and Solution Architects to ensure the infrastructure and pipelines meet performance, scalability, and compliance requirements. Follows best practices for platform security, auditing, and...

Date Opened 15/04/2026 Job Type Contract About Scrumconnect Scrumconnect Consulting is a UK-based digital transformation consultancy delivering agile, secure technology solutions for public and private sector clients. This is a fully remote role based in India, supporting our UK operations and client base. You will work closely with our UK leadership team and must be comfortable operating within UK regulatory and legal frameworks. About the role You will join a data engineering team responsible for building and maintaining a large-scale, longitudinal data asset that draws on multiple source systems and channels. The pipeline extracts, transforms, and loads data into a trusted analytical resource accessed by a broad community of data users and analysts. Key responsibilities Pipeline development Design, build, and maintain ETL/ELT data pipelines that extract from multiple sources, apply transformations, and load into a governed analytical...

Date Opened 15/04/2026 Job Type Contract About Scrumconnect   Scrumconnect Consulting is a UK national SME award-winning software development consultancy with over 300 consultants across the UK. We work with UK Public Sector clients to build impactful, award-winning digital services that improve millions of lives.   We take as much pride in our people, culture and work-life balance as we do in making services that improve millions of lives. Collaborative, entrepreneurial and dedicated to problem-solving, we bring the step change our customers need to sustain innovation.     About the role   You will work as a forward deployed engineer embedded within a security-focused capability unit, designing, building, and deploying AI-powered tools that drive measurable improvements in cyber security and fraud prevention. Working closely with technical teams and operational stakeholders, you will turn requirements into...