123 data engineer jobs found

Job Information Date Opened 11/12/2025 Job Type Contract Work Experience 5+ years Industry Government & Public Sector Salary 350 - 400 GBP per day City London Province Greater London Country United Kingdom Postal Code EC1A Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy recognised for delivering impactful technology solutions across UK government departments. Our work has positively influenced the lives of more than 40 million UK citizens . We are committed to user-centred design, agile delivery, and bringing innovation to digital services that truly matter. Role Overview We are seeking an experienced Data Engineer to design, build, and maintain data products and a modern Strategic Data Platform . You will work within multi-functional Agile delivery teams,...

Job Description Who we are looking for We are looking for a person who is passionate about the possibilities of data-driven culture and the advantages that organisations adopting data-driven learning can have in this rapidly changing market environment. The primary focus of the Principal Data Engineer role is collaborating with stakeholders on various levels to gain a deep understanding of existing business processes and needs and implement end to end reporting & analytics solutions applying the latest enterprise engineering practices ensuring security, performance, and quality standards. About Schroders We are a global investment manager. We help institutions, intermediaries and individuals around the world invest money to meet their goals, fulfil their ambitions, and prepare for the future. We have around 6,000 people on six continents. And we have been around for over 200 years but keep adapting as society and technology changes. What does not change is our...

We at Coforge Hiring: Data Engineer – MRO(Maintenance, Repair and Overhaul) AI Solutions (Embedded in BA) /Fixed Term Contractor/ 3days onsite   Responsibilities: Develop and optimize data pipelines for ingestion, transformation, and storage Ensure data quality, integrity, and security Collaborate with Data Scientists and Analysts for advanced analytics Implement best practices for cloud scalability and performance Support integration of AI solutions into BA operational workflows Design modular, interoperable data architectures for multi-OpCo deployment   Key Skills: Expertise in Python, SQL, and modern ETL frameworks Hands-on experience with AWS or other cloud platforms Strong knowledge of data modeling and API integration Proven experience deploying data solutions beyond prototypes Airline or logistics domain knowledge is a plus Ability to integrate quickly and deliver immediate value Willingness to...

Data Engineer (Azure | Databricks | ETL Pipelines) Contract | Remote | UK Public Sector Project   Ceox Services are seeking a Data Enginee r to support delivery of key data component s within our evolving data ecosyste m. This role will work closely with architects, analysts, engineer s, and wider delivery teams to implement pipeline builds, data models, and integration pattern s aligned to the organisation’s new Target Operating Model for Dat a .You will contribute to the development of scalable dataflow s, optimise ingestion & transformatio n activities, and ensure solutions meet technical standards, performance expectations, and security control s. This is a hands-on engineering rol e ideal for someone who enjoys building, shaping, and improving modern data platform s   . Who We’re Looking F orA highly capabl e Data Engine er with hands-on experience buildin g ETL pipelin es, implementin g Data Lake + Delta...

On behalf of DSIT we are looking for a Principal Data Engineer (Inside IR35) for a 3 month contract (until 31/03/26) . Remote working.  The Department for Science, Innovation and Technology (DSIT) brings together the relevant parts of the former Department for Business, Energy, and Industrial Strategy (BEIS) and the former Department for Digital, Culture, Media and Sport (DCMS). The responsibilities for the DSIT are: Positioning the UK at the forefront of global scientific and technological advancement. Driving innovations that change lives and sustain economic growth. Delivering talent programmes, physical and digital infrastructure, and regulation to support our economy, security, and public services. R&D funding. The Technology & Science Insights (TSI) team in the Government Office for Science has recently completed a major data transition project, moving from API ingestion to internally hosted data on a cloud platform. This strategic shift has...

Senior Data Engineer On-site Full time Methods Business and Digital Technology Limited Methods is a £100M+ IT Services Consultancy who has partnered with a range of central government departments and agencies to transform the way the public sector operates in the UK. Established over 30 years ago and UK-based, we apply our skills in transformation, delivery, and collaboration from across the Methods Group, to create end-to-end business and technical solutions that are people-centred, safe, and designed for the future. Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and the planet. We support our clients in the success of their projects while working collaboratively to share skill sets and solve problems. At Methods we have fun while working hard; we...

The Department for Science, Innovation and Technology (DSIT) brings together the relevant parts of the former Department for Business, Energy, and Industrial Strategy (BEIS) and the former Department for Digital, Culture, Media and Sport (DCMS).   The responsibilities for the DSIT are: Positioning the UK at the forefront of global scientific and technological advancement. Driving innovations that change lives and sustain economic growth. Delivering talent programmes, physical and digital infrastructure, and regulation to support our economy, security, and public services. R&D funding.   The Technology & Science Insights (TSI) team in the Government Office for Science has recently completed a major data transition project, moving from API ingestion to internally hosted data on a cloud platform. This strategic shift has improved cost efficiency, data quality, and automation.   We are seeking a highly skilled Principal Data...

About the Job   We are seeking a highly skilled and motivated Data Architect to join our team. The successful candidate will play a pivotal role in shaping and delivering data strategies across multiple concurrent projects. You will work closely with software engineers, customers, and stakeholders to understand data requirements, design robust architectures, and champion best practices in data engineering, analysis, and security.   Key Responsibilities: Data Architecture Design: Develop and maintain data models, data flow diagrams, and integration patterns aligned with defence sector standards. Client Engagement: Collaborate with clients to understand business needs, translate them into data requirements, and propose fit-for-purpose solutions. Governance & Compliance: Ensure data solutions comply with MOD, government and company data protection policies, including handling of classified and sensitive information. Technology...

The Ministry of Justice (MoJ) priorities include improving public safety and reducing reoffending by reforming prisons, probation and youth justice, and building a justice system which makes access to justice swifter and more certain for all citizens whatever their background. Project professionals in the MoJ help to improve the government's ability to protect the public and reduce reoffending, and to provide a more effective, transparent and responsive criminal justice system for victims and the public.   HMPPS data engineers in the Data Modelling and Engineering team build and maintain data pipelines to our Analytical Platform from operational prison and probation services. Our analytics engineers build dimensional models on top of these data pipelines to provide useful and usable data to downstream users, including analysts, performance teams and data scientists. Over time, this is reducing dependence on manual, legacy processes that are time-consuming, error-prone...

Staff Software Engineer – Robotics & Life Sciences Automation Location: London, UK - Hybrid (3 days/week on site) Contract: 4 months with possibility of extension Start: ASAP (Dec 2025 / Jan 2026) Automata: accelerating breakthroughs that save lives Automata builds automation that accelerates life sciences: enabling faster drug discovery, next-generation personalised medicines, and high-precision diagnostics where turnaround time can mean the difference between life and death. We believe the future of biology depends on automation that is reliable, scalable and accessible — and we’re building the platform that makes that possible. Our modular lab bench and digital automation platform already run mission-critical workflows in leading research organisations. The next evolution of our product will scale globally, unify robotics with reproducible software interfaces, and redefine how scientists interact with instruments. And we’re building...

Technical Lead (Contract, UK, Remote) This is a contract full time remote opportunity for those based in the UK. About Nearform Nearform is an independent team of data & AI experts, engineers, and designers who build intelligent digital solutions and capability at pace. We create AI-enabled solutions that enhance digital experiences, empower developers, and deliver measurable results. In these ways, we partner with ambitious enterprises to deliver enduring impact. Our deep expertise in solving the world’s most complex digital problems, along with our collaborative, people-first approach, enables enterprises to build breakthrough products and modernise legacy systems by unleashing the power of AI. Today, our team of 500 experts in 20+ countries is trusted by leading enterprises including Lululemon, Puma, Sun Life, Starbucks, Travelex, Virgin Media 02, and Walmart. As part of our Engineering function, you will work closely with clients to translate complex...

HMPPS data engineers in the Data Modelling and Engineering team build and maintain data pipelines to our Analytical Platform from operational prison and probation services. Our analytics engineers build dimensional models on top of these data pipelines to provide useful and usable data to downstream users, including analysts, performance teams and data scientists. Over time, this is reducing dependence on manual, legacy processes that are time-consuming, error-prone and inefficient. With new microservices being developed by Digital Prisons and Probation Services to replace existing operational databases substantial data and analytics engineering support is required to maintain critical feeds of data to downstream applications. Current models have been developed in a piecemeal manner for specific reporting requirements. Given the current scale of change, we would like to take a step back to develop a more comprehensive data model which reflects business processes and...

About the Role We are seeking an experienced Azure Databricks & Airflow Engineer to join our Data Engineering team on a 6-month contract . The ideal candidate will have strong hands-on expertise in Data Engineering, Databricks, Apache Airflow, PySpark, Python, Unity Catalog, and Data Modelling , ideally within banking or financial services . The role involves designing, building, and optimizing scalable data pipelines, ensuring data governance, and enabling robust analytics and reporting capabilities.   Key Responsibilities Develop and maintain data pipelines using Azure Databricks, Apache Airflow, PySpark, Python , and related Azure services. Implement and manage Unity Catalog for data governance, lineage, access controls, and cataloging of datasets. Design and optimize data models (Dimensional, Star, Snowflake schemas) for analytical reporting and data warehousing in financial environments. Monitor, optimize, and troubleshoot...

3h ago Job Title:  Technical Industrialisation Squad Team Member Engagement Type:   Umbrella/PAYE Location:   London - Remote   (ALL KPMG UK CONTRACTORS MUST RESIDE AND HAVE PROOF OF RIGHTS TO WORK IN THE UK)     Overview: Deliver key technical industrialisation work packages to support the industrialisation of the tools developed during the programme.     KPMG UK is looking for a Generative AI Engineer to join the team. In this role, you will be involved in the development and deployment of generative AI models and solutions, supporting key projects, and driving impactful AI initiatives. You’ll work closely with senior AI professionals and contribute to designing and implementing AI solutions that deliver real business value.    AI Solution Development:   Assist in the design and development of generative AI models and solutions across various projects Work with senior...

Job Title: ETF Data Analyst/Specialist/Scientist Location: Remote (European Time Zone) Contract Type: B2B   About us: ETFbook is a Swiss SaaS company providing data, analytics, and custom solutions in the Exchange Traded Funds (ETFs) space. Founded in 2020, the we aim to make global ETF data accessible, actionable, and valuable for institutional participants, including ETF issuers, index providers, fund service providers, market makers, exchanges, and buy-side institutions. We develop a platform which offers comprehensive insights through a user-friendly web application and robust APIs, covering areas such as product analysis, fund flow tracking, performance comparisons, and liquidity assessments.   About the role: You’ll join a highly skilled data analysts team, part of the data department. This team is responsible for shaping data roadmap across three regions incl. EMEA, AMER and APAC, acquiring and defining data and...

. Methods Business and Digital Technology Limited Methods is a £100M+ IT Services Consultancy who has partnered with a range of central government departments and agencies to transform the way the public sector operates in the UK. Established over 30 years ago and UK-based, we apply our skills in transformation, delivery, and collaboration from across the Methods Group, to create end-to-end business and technical solutions that are people-centred, safe, and designed for the future. Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and the planet. We support our clients in the success of their projects while working collaboratively to share skill sets and solve problems. At Methods we have fun while working hard; we are not afraid of making mistakes and...

. Methods Business and Digital Technology Limited Methods is a £100M+ IT Services Consultancy who has partnered with a range of central government departments and agencies to transform the way the public sector operates in the UK. Established over 30 years ago and UK-based, we apply our skills in transformation, delivery, and collaboration from across the Methods Group, to create end-to-end business and technical solutions that are people-centred, safe, and designed for the future. Our human touch sets us apart from other consultancies, system integrators and software houses - with people, technology, and data at the heart of who we are, we believe in creating value and sustainability through everything we do for our clients, staff, communities, and the planet. We support our clients in the success of their projects while working collaboratively to share skill sets and solve problems. At Methods we have fun while working hard; we are not afraid of making mistakes and...

Senior Software Engineer – Kubernetes Platform Team Location: London (Cannon Street) Contract: 6 months Hours: Full Time   About the Role   We are recruiting on behalf of Fidelity International for a Senior Software Engineer to join our Kubernetes Platform Team . This is an exciting opportunity to work in a global organisation that prioritises innovation, resilience, and client-first technology solutions.   Responsibilities   Participate in all areas of platform development and operations. Identify challenges, research and propose solutions, and drive them through to production. Take ownership of epics, implement solutions iteratively, and guide technical direction for the platform. Collaborate with product owners, application developers, security, and data teams to refine product vision and maintain a clear backlog. Contribute to enterprise architecture reviews, ensuring engineering quality...

hiring experienced Python Engineers to support a variety of high-impact research collaborations with leading AI labs. Freelancers will help improve AI systems through work extending coding benchmarks that reflect real-world development across diverse languages and domains. This is a unique opportunity to apply your engineering expertise toward shaping the next generation of intelligent systems. Key Responsibilities Develop and validate coding benchmarks in Python by curating issues, solutions, and test suites from real-world repositories Ensure benchmark tasks include comprehensive unit and integration tests for solution verification Maintain consistency and scalability of benchmark task distribution Provide structured feedback on solution quality and clarity Debug, optimize, and document benchmark code for reliability and reproducibility Ideal Qualifications 3–10 years of experience as a backend software engineer, ML engineer,...

Who are we: In 2019, our founders were working as engineers solving complex cross domain problems within government organisations TwinStream was formed to consolidate their collective expertise and experience into one business, providing technical excellence and exceptional service to their clients. We have teams working both on-site with clients and remotely from home.   Details : Employment: Contract (outside of IR35) Rate: £500 - £600 Security Level: Must have live DV- clearance Location: 5 days in either Cheltenham   About the role: Successful candidates will be working as part of an on-site team to maintain and support a managed cross-domain service using a wide range of technology, platforms and tools. The team employ site reliability engineering tools and practices to continuously verify and improve the service.   Responsibilities: Build and Deploy code from multiple project teams:...