151 senior data engineer jobs found

Role description Role Senior Data Engineer Sheffield, UK 6 Months contract Rate: 65 GBP per hour inside IR35     Experience 7 to 11     Responsibilities Design build and maintain largescale data pipelines and ETL workflows across enterprise datasets Ingest provision and manage raw enriched and curated data assets for analytics platforms Improve reliability scalability and realtime data ingestion capabilities Support and enhance cloudbased data ingestion infrastructure and platform services Acquire transport clean transform and integrate data from internal and external sources Perform exploratory data analysis and onboard new data sources Develop automated data engineering workflows and optimize data processing pipelines Manage data modelling data warehousing data integration and data cataloguing activities Support realtime analytics and streaming data platforms Contribute to cloud...

450-500 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme. The Role This role is suited to a highly experienced data professional with strong architecture and engineering capabilities across cloud-based data platforms and modern application environments. The successful candidate will...

Senior Data Engineer - Snowflake/SQL/Data Modelling 6 month contract Edinburgh - hybrid working pattern We are seeking an experienced Data Engineer to join a new programme of work for our financial services client. This is an excellent opportunity for a highly capable data professional with strong SQL, Snowflake and data modelling expertise to support the delivery of a significant data-led initiative. The successful candidate will play a key role in the analysis, development and migration of data outcomes associated with spinning up a new Snowflake data platform, while also supporting the migration of customers away from the current SQL based platform. Key responsibilities Deliver the analysis, development and migration of data outcomes associated with new project Design, build and maintain robust data engineering solution for the new Snowflake data platform Use Snowflake to support scalable and efficient data delivery Contribute to data modelling and...

Role description Role Senior Data Engineer Sheffield, UK 6 Months contract Rate: 65 GBP per hour inside IR35     Experience 7 to 11     Responsibilities Design build and maintain largescale data pipelines and ETL workflows across enterprise datasets Ingest provision and manage raw enriched and curated data assets for analytics platforms Improve reliability scalability and realtime data ingestion capabilities Support and enhance cloudbased data ingestion infrastructure and platform services Acquire transport clean transform and integrate data from internal and external sources Perform exploratory data analysis and onboard new data sources Develop automated data engineering workflows and optimize data processing pipelines Manage data modelling data warehousing data integration and data cataloguing activities Support realtime analytics and streaming data platforms Contribute to cloud...

450-500 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme. The Role This role is suited to a highly experienced data professional with strong architecture and engineering capabilities across cloud-based data platforms and modern application environments. The successful candidate will...

SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position (short-term nature of this role and speed at which we require a postholder in situ) preference may be given to candidates who meet all of the essential criteria and hold active SC clearance.    The Department for Work and Pensions (DWP) is responsible for welfare, pensions, and child maintenance policy. As the UK's biggest public service department, it administers the State Pension and a range of working age, disability and ill health benefits to around 20 million claimants and customers. As such, we operate on a scale that is almost unmatched anywhere in Europe and most people in Britain come into contact with us at some point in their lives.   Working with DWP, you will be helping us to drive our priorities to:   Help people to move into work and...

Senior Data Engineer (Python / ETL / SQL) Associate | Flexible rate | Remote Overview We're supporting a large-scale Workday HCM implementation and are looking for several experienced Data Engineers to join the programme immediately. This is a hands-on role working alongside senior stakeholders and delivery partners to support data migration, transformation and integration activities, helping ensure the successful delivery of a critical HR transformation programme.   What you'll be doing Supporting data migration and transformation activities for a Workday HCM implementation Designing and building data pipelines and ETL processes Extracting, cleansing, transforming and loading data into Workday Working closely with business, HR and technology stakeholders to resolve data quality challenges Supporting data validation, reconciliation and testing activities Collaborating with implementation partners and...

Job Title: Senior Data Engineer Location: Reading (Hybrid) Contract Length: 6 Months Rate: £500 a Day   Key Responsibilities Design and maintain secure, scalable, cloud-based data platforms and architectures. Develop enterprise data pipelines, integration frameworks, and data products. Implement DataOps, DevOps, CI/CD, and Infrastructure as Code best practices. Ensure data quality, governance, security, compliance, and operational reliability. Support cloud migration and data modernisation programmes. Provide technical leadership, mentoring, and stakeholder engagement. Enable advanced analytics, AI, and data-driven decision-making capabilities.   Requirements Experience within Defence, MOD, Aerospace, or highly regulated environments. 7+ years' experience in Data Engineering, Data Platforms, or related disciplines. Strong expertise in enterprise-scale data architecture and cloud data...

450-500 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme. The Role This role is suited to a highly experienced data professional with strong architecture and engineering capabilities across cloud-based data platforms and modern application environments. The successful candidate will...

Skills & Experience Job roles: Data Engineer Experience level: Senior Tech stack/tooling used: dbt, Snowflake, SQL Core skills considered: dbt, SQL, Python, Snowflake Logistics Base salary: £400 - £500 per day Employment type: Freelance/Contract Remote working: Hybrid (up to 3 remote days p/w) Visa sponsorship: Not available Job Description Location: London, Fleet Street (Hybrid) Contract: Initial 6 Months Start Date: ASAP Work Pattern: Minimum 3 days per week in the office, with flexibility for more office-based working if preferred. About the Role We're looking for an experienced Senior Data Engineer Contractor to join our growing Data team on a project-focused engagement. Over the coming months, several business-critical applications are being deployed into production, creating a significant volume of...

Location: London, Fleet Street (Hybrid) Contract: Initial 6 Months Start Date: ASAP Work Pattern: Minimum 3 days per week in the office, with flexibility for more office-based working if preferred.   About the Role We're looking for an experienced Senior Data Engineer Contractor to join our growing Data team on a project-focused engagement.   Over the coming months, several business-critical applications are being deployed into production, creating a significant volume of data remodelling work as source systems evolve. We're looking for someone who can quickly embed into the team, take ownership of this workstream, and deliver impact from day one.   This role is ideally suited to someone with a strong consultancy or contracting background who enjoys solving complex data transformation challenges and is comfortable operating with minimal oversight.   What You'll Be Doing Remodelling and transforming data as...

Senior Full Stack Data Quality Engineer Assignment type: Outside IR35   The supplier will be engaged to provide specialist hands-on data quality engineering services to the Finance & Data Reporting Product Team across TMHCC’s modern data platform testing, data quality engineering, and test automation.   The engagement is focused on delivering agreed testing and automation outcomes across defined operational assurance priorities and initiative delivery outcomes. The supplier will validate data across the full data lifecycle, including ingestion, transformation, data lake, data warehouse, reporting and BI, APIs, metadata, lineage, and reconciliation.   Assignment Tasks / Deliverables   Full Stack Data Quality Engineering: Design and execute data quality testing across ingestion, transformation, warehouse, reporting/BI, APIs, metadata, lineage, and reconciliation layers. Validate Snowflake data lake and data...

Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you 'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.   What We Do The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.   About the Role This is a freelance role for a...

Mindrift is looking for highly skilled Vibecode specialists to join the Tendem project (https://tendem.ai/) and drive specialized data scraping workflows for real-world use cases. Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows for real-world applications. In this role, you 'll apply your expertise in web scraping, data extraction, and data processing to deliver accurate, reliable, and high-quality results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.   What We Do The Mindrift platform connects specialists with innovative technology projects. Our mission is to help develop high-quality AI technologies by combining real-world expertise from professionals across the globe with advanced AI development efforts.   About the Role This is a freelance role for a...

Senior Full Stack Data Quality Engineer Assignment type: Outside IR35   The supplier will be engaged to provide specialist hands-on data quality engineering services to the Finance & Data Reporting Product Team across TMHCC’s modern data platform testing, data quality engineering, and test automation.   The engagement is focused on delivering agreed testing and automation outcomes across defined operational assurance priorities and initiative delivery outcomes. The supplier will validate data across the full data lifecycle, including ingestion, transformation, data lake, data warehouse, reporting and BI, APIs, metadata, lineage, and reconciliation.   Assignment Tasks / Deliverables   Full Stack Data Quality Engineering: Design and execute data quality testing across ingestion, transformation, warehouse, reporting/BI, APIs, metadata, lineage, and reconciliation layers. Validate Snowflake data lake and data...

Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot - that's how we refer to this role at Mindrift - you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands-on experience in web scraping, data extraction and processing.   What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real-world expertise from across the globe.   This is a freelance role for a Tendem project. As a Senior Python Data Scraping Engineer, you 'll handle data scraping tasks requiring technical...

500-550 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme.   Job Summary We are looking for an experienced Senior Technical Architect with strong expertise in GDS (Global Distribution Systems) and enterprise application architecture. The ideal candidate will be responsible for...

500-550 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme.   Job Summary We are looking for an experienced Senior Technical Architect with strong expertise in GDS (Global Distribution Systems) and enterprise application architecture. The ideal candidate will be responsible for...

Senior Data Engineer (Azure | Databricks | PySpark | SQL) Contract | Remote | UK Public Sector Project   Overview We are seeking a Senior Data Engineer to support the delivery of key data components within our evolving data ecosystem. This role will work closely with architects, analysts, engineers, and wider delivery teams to implement pipeline builds, data models, and integration patterns aligned to the organisation’s new Target Operating Model for Data.   You will contribute to the development of scalable data flows, optimise ingestion & transformation activities, and ensure solutions meet technical standards, performance expectations, and security controls. This is a hands-on engineering role ideal for someone who enjoys building, shaping, and improving modern data platforms.   Who We're Looking for A highly capable Data Engineer with hands-on experience building ETL pipelines, implementing Data Lake...

500-550 Outside IR35 City Staines Province Surrey Country United Kingdom Postal Code TW18 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading digital transformation consultancy delivering innovative solutions across the UK public sector. We specialise in Agile delivery, digital services, cloud transformation, data, and user-centred design, helping organisations build scalable and impactful digital products and platforms. We are currently seeking an experienced Senior Data Engineer / Architect to support the design of the WebCAF database, risk reporting tools, and integration services within a major digital transformation programme.   Job Summary We are looking for an experienced Senior Technical Architect with strong expertise in GDS (Global Distribution Systems) and enterprise application architecture. The ideal candidate will be responsible for...