100 data engineer jobs found in London

Role : Microsoft 365 & SharePoint Data Engineer Location: UK Type: Contract The Context: Thebes Group is an optimisation company specialising in AI-enabled transformation. We help organisations improve workflow, reporting, information management, and operational decision-making by combining process optimisation, knowledge architecture, semantic technologies, automation, and artificial intelligence. We are currently delivering an AI transformation programme for a private equity group, focused on enhancing group-level operations through intelligent workflows, improved information accessibility, executive reporting, and AI-driven operational intelligence. The Microsoft 365 and SharePoint environment is the operational backbone through which much of the group's information flows: documents, reporting, collaboration, and process. Getting that environment right, and connecting it properly to the AI and knowledge layers being built, is critical to the success of the...

Role: Data Engineer (Migration Lead) Salary: 600 - 650 (OutsideIR35) - Hybrid Location: London Key Essential Skills: Experience working in fast-paced, private equity-backed or financial markets environments. Proven experience leading large-scale data migration projects within SharePoint/Microsoft 365 environments. Strong hands-on experience with SharePoint Online, SharePoint On-Premises, Microsoft Teams, OneDrive, Exchange Online, and Entra ID (Azure AD). Experience managing Microsoft 365 security and compliance settings. Strong understanding of data governance, data classification, DLP, DRM, encryption, and security best practices. Experience designing and executing migration strategies for structured and unstructured data. Knowledge of Power BI and enterprise reporting solutions. Strong understanding of Microsoft Copilot, AI technologies, and Large Language Models (LLMs). Excellent stakeholder management, communication, and project...

Data Engineer - Outside IR35 - Contract - SC ESSENTIAL   A rare opportunity to join our fast-growing technology company selling high-value software development services. You will be working within a Government department as part of an existing team to support the rollout of a new Database.   Must have   Several years' experience with data modelling, data mapping, and defining data standards Experience working with complex, multi-organisation data landscapes Track record of delivering clarity in the presence of ambiguity Experience working with senior stakeholders to define strategy   Nice to have   Experience working with central and/or local government Familiarity with housing / property / regulatory datasets Experience implementing data standards that have already been defined   Your approach   You are passionate about delivering great technical quality, whether...

MAKE STRATEGY A REALITY | ACCELERATE YOUR GROWTH | CHOOSE YOUR PATH As the world's leading change and transformation consultancy, we're helping businesses move from strategy to reality by taking a pragmatic and practical approach to build solutions that last. We're seeking a Data Engineer to help us take vision to value and create lasting impact for our Central Government client please note, this is an initial 3-6 month PAYE Umbrella contract that will require onsite working in London 2-3 days per week. Applicants must also have a valid SC clearance used in the last 12 months. Due to the nature of the role, applicants must also be a UK national or hold UK dual citizenship. Summary As a Data Engineer, you will play a crucial role in harnessing the power of data to drive positive change. Your expertise in data management and analysis will enable the organisation to make informed decisions and deliver impactfull solutions to address complex challenges. You...

Role: M365 Data engineer Salary: 600 - 650 (OutsideIR35) - Hybrid Location: London Key Essential Skills Strong Microsoft 365 configuration and administration experience. Hands-on expertise with Exchange Online, Microsoft Teams, SharePoint Online, Intune, and Entra ID/Azure AD. Hands on in architecting and deploying Power BI. Strong complementary data security strategies - Digital Rights Management (DRM) and Data Loss Prevention (DLP). Strong understanding of Microsoft Copilot, AI tools, and LLM technologies. Proven experience delivering data projects with built-in security, ensuring end-to-end encryption and data classification. Must have experience working within fast-paced/private equity-backed environments. Desirable Skills: Experience managing Microsoft 365 security and compliance settings. Experience with PowerShell administration and automation. Knowledge of Microsoft Defender and Purview. Strong...

Senior Data Engineer – Databricks & Big Data Pipelines (SC Cleared is required for this role)     Rate: £450-550 per day inside IR35   We're looking for a Senior Data Engineer – Databricks & Big Data Pipelines to join our team, working in our UK remote working division. This position requires active UK Security Check (SC) clearance and offers the opportunity to build advanced, large-scale data engineering solutions for an innovative analytics platform. You will design, develop and optimize distributed data pipelines on Databricks and cloud ecosystems while ensuring performance, scalability, and compliance. The role combines technical depth with client-facing delivery as part of an agile and collaborative environment.   Responsibilities Design, develop and optimize end-to-end data pipelines using Databricks, Spark/PySpark and Python Lead the full pipeline lifecycle: analysis, architecture, development,...

Data Engineer - Outside IR35 - Contract - SC ESSENTIAL   A rare opportunity to join our fast-growing technology company selling high-value software development services. You will be working within a Government department as part of an existing team to support the rollout of a new Database.   Must have   Several years' experience with data modelling, data mapping, and defining data standards Experience working with complex, multi-organisation data landscapes Track record of delivering clarity in the presence of ambiguity Experience working with senior stakeholders to define strategy   Nice to have   Experience working with central and/or local government Familiarity with housing / property / regulatory datasets Experience implementing data standards that have already been defined   Your approach   You are passionate about delivering great technical quality, whether...

450-500 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme. The Role This role is suited to a highly experienced data professional with strong architecture and engineering capabilities across cloud-based data platforms and modern application environments. The successful candidate will...

450-500 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme. The Role This role is suited to a highly experienced data professional with strong architecture and engineering capabilities across cloud-based data platforms and modern application environments. The successful candidate will...

Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme. The Role This role is suited to a highly experienced data professional with strong architecture and engineering capabilities across cloud-based data platforms and modern application environments. The successful candidate will lead the design and implementation of scalable and secure data solutions, working closely with technical teams, delivery stakeholders, and end users to support reporting, analytics, and operational data services....

About CACI From our headquarters in London, we're busy empowering organisations to make bold, strategic moves with the power of data and technology. Founded in 1975, our operations take place from multiple offices across the UK, Europe and India with over 1600 Full time employees and an annual turnover of £179m. Our expertise spans industries, from retail and education to public sector and transport - delivering intelligent solutions that drive progress and create measurable impact. Whether it's business intelligence, customer marketing, cloud infrastructure, cybersecurity, critical national infrastructure or data management, our approach is never one-size-fits-all. We don't just deliver solutions; we build for the tomorrow's world, all while fostering a culture that allows employees to be their authentic selves and succeed in their careers. The role We are currently looking to hire a CRM Data Engineer to join the team here at CACI and work with one of our customers in...

About CACI From our headquarters in London, we’re busy empowering organisations to make bold, strategic moves with the power of data and technology. Founded in 1975, our operations take place from multiple offices across the UK, Europe and India with over 1600 full-time employees and an annual turnover of £179m. Our expertise spans industries, from retail and education to public sector and transport – delivering intelligent solutions that drive progress and create measurable impact. Whether it’s business intelligence, customer marketing, cloud infrastructure, cybersecurity, critical national infrastructure or data management, our approach is never one-size-fits-all. We don’t just deliver solutions; we build for the tomorrow’s world, all while fostering a culture that allows employees to be their authentic selves and succeed in their careers.   The role We are currently looking to hire a CRM Data Engineer to join the...

Location Reading Department Engineering Employment Type Consultant Minimum Experience Experienced Job Description P.I. Works is the first company in the world to automate the management of a commercial 5G network.    Our automated network management products and services empower mobile operators to accelerate network transformation and to drive network quality and efficiency on the path to 5G. These solutions have been deployed across more than 85 mobile operators in 58 countries around the world.       Our success is built by our people that strive for excellence and deliver great value to our customers.    At the core of our success are a culture built on integrity, trust, and respect. We are looking for a Network Data Solutions Delivery Engineer to lead mobile network product delivery projects, with a focus on next-generation...

Azure Solution Architect (SC Cleared) London, United Kingdom | Posted on 05/06/2026 About Scrumconnect Consulting Scrumconnect Consulting  is a leading UK digital and technology consultancy specialising in delivering impactful, user-centred services for the public sector. We work with central government departments, agencies, and local authorities to build digital products and services that improve outcomes for citizens. With a team of engineers, architects, delivery professionals, and designers, we bring deep expertise in digital transformation, cloud technologies, and agile delivery. We are committed to engineering excellence, innovation, and creating an inclusive environment where everyone can thrive. Role Overview We are seeking an experienced  Azure Solution Architect  to design, architect, and deliver scalable, secure, and high-performance cloud data solutions on Microsoft Azure. This role requires deep expertise in ...

Job Title: Product Owner / Business Analyst Location: London Position Type: Contract Must-Have Experience & Skills - 7–12 years across product and business analysis roles in enterprise B2B delivery (consulting, system integrators, or in-house enterprise IT). - Enterprise stakeholder management expertise: confident presenting to CxO-level sponsors, navigating complex client organizations, and steering sprint reviews—even when things get tough. - Agile fluency: deep knowledge of Scrum/SAFe, mastery of Jira and Confluence, and a proven track record of running predictable sprints across distributed teams. - SQL proficiency: able to independently query SAM/data warehouses to validate business questions. Joins, window functions, and aggregations are second nature—you don’t need a data engineer to answer “do we even have this data?” - Functional literacy across the stack: while you don’t code, you can read architecture diagrams, follow sequence flows, and reason about...

500-550 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme.   Job Summary We are looking for an experienced Senior Technical Architect with strong expertise in GDS (Global Distribution Systems) and enterprise application architecture. The ideal candidate will be responsible for...

500-550 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme.   Job Summary We are looking for an experienced Senior Technical Architect with strong expertise in GDS (Global Distribution Systems) and enterprise application architecture. The ideal candidate will be responsible for...

Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme.   Job Summary We are looking for an experienced Senior Technical Architect with strong expertise in GDS (Global Distribution Systems) and enterprise application architecture. The ideal candidate will be responsible for designing scalable technology solutions, leading architecture discussions, and driving digital transformation initiatives within the travel domain. The candidate should possess deep knowledge of travel technologies,...

Role : Knowledge Graph Architect Location: UK Type: Contract The Context: Thebes Group is an optimisation company specialising in AI-enabled transformation. We help organisations improve workflow, reporting, information management, and operational decision-making by combining process optimisation, knowledge architecture, semantic technologies, automation, and artificial intelligence. We are currently delivering an AI transformation programme for a private equity group, focused on enhancing group-level operations through intelligent workflows, improved information accessibility, executive reporting, and AI-driven operational intelligence. A foundation ontology, taxonomy and initial knowledge graph exist. The data is mapped, manageable in scope, and well understood within the team. An Ontology Engineer sits alongside this role to own the semantic foundation, and an AI engineer handles the agent build. The Knowledge Graph Architect takes the semantic models produced...

Role : Ontology Engineer Location: UK Type: Contract The Context: Thebes Group is an optimisation company specialising in AI-enabled transformation. We help organisations improve workflow, reporting, information management, and operational decision-making by combining process optimisation, knowledge architecture, semantic technologies, automation, and artificial intelligence. We are currently delivering an AI transformation programme for a private equity group, focused on enhancing group-level operations through intelligent workflows, improved information accessibility, executive reporting, and AI-driven operational intelligence. A foundation ontology and taxonomy already exists. The data is mapped, manageable in scope, and well understood within the team. This is not a build-from-scratch engagement. A Knowledge Graph Architect sits alongside this role to make the semantic structures operational, and an AI engineer handles the agent build. The Ontology Engineer...