345 data engineer jobs found

About CACI From our headquarters in London, we’re busy empowering organisations to make bold, strategic moves with the power of data and technology. Founded in 1975, our operations take place from multiple offices across the UK, Europe and India with over 1600 full-time employees and an annual turnover of £179m. Our expertise spans industries, from retail and education to public sector and transport – delivering intelligent solutions that drive progress and create measurable impact. Whether it’s business intelligence, customer marketing, cloud infrastructure, cybersecurity, critical national infrastructure or data management, our approach is never one-size-fits-all. We don’t just deliver solutions; we build for the tomorrow’s world, all while fostering a culture that allows employees to be their authentic selves and succeed in their careers.   The role We are currently looking to hire a CRM Data Engineer to join the...

Senior Data Engineer – Databricks & Big Data Pipelines (SC Cleared is required for this role)     Rate: £450-550 per day inside IR35   We're looking for a Senior Data Engineer – Databricks & Big Data Pipelines to join our team, working in our UK remote working division. This position requires active UK Security Check (SC) clearance and offers the opportunity to build advanced, large-scale data engineering solutions for an innovative analytics platform. You will design, develop and optimize distributed data pipelines on Databricks and cloud ecosystems while ensuring performance, scalability, and compliance. The role combines technical depth with client-facing delivery as part of an agile and collaborative environment.   Responsibilities Design, develop and optimize end-to-end data pipelines using Databricks, Spark/PySpark and Python Lead the full pipeline lifecycle: analysis, architecture, development,...

UK Research and Innovation (UKRI) is the national funding agency investing in science and research in the UK.   UKRI invests £8 billion of taxpayers’ money each year into research and innovation and the people who make it happen. They work across a huge range of fields – from biodiversity conservation to quantum computing, and from space telescopes to innovative health care. They give everyone the opportunity to contribute and to benefit, bringing together people and organisations nationally and globally to create, develop and deploy new ideas and technologies.   The Data Engineer will be responsible for the requirements analysis and design of solutions for data platforms, ETL, integration and analysis solutions. Our toolset includes AWS hosted databases (postgres, S3 based data lake, MySQL, Athena), integration services (AWS API gateway, lambda functions), ETL services (AWS Glue, Step functions, AWS Batch), infrastructure management tools...

400-450 Inside IR35 City Newcastle upon Tyne Province Tyne and Wear Country United Kingdom Postal Code NE1 Job Description Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: Data Engineer (DataStage & Oracle | Regulatory / Risk Data Warehouse) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP We...

Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule. We are looking for a proficient Data Engineer to help advance AI development. As a member of DataAnnotation’s coding team, you’ll be part of a growing community of over 100,000 professionals — including front-end, back-end, full-stack, machine learning, and other engineers — who are driving real-world impact in AI development. Our platform offers an engaging blend of flexibility and challenge: you’ll work closely with state-of the art AI models to take on programming tasks that include creating and solving challenging coding problems, building beautiful apps with rich functionality, and synthesizing insights through data analysis and visualization. Your work directly contributes to refining intelligent systems that learn, adapt, and evolve. Some team members fit this work alongside a...

Whitebridge is looking for a Data Engineer with expertise in Microsoft Azure (also Databricks, ADF) Key experience required: Extensive experience in programming/query language skills including Python/PySpark and SQL. Data engineering experience - via data preparation, transformation & conversion to allow for rapid processing of system data across a number of different formats & structures Experience in Databricks, Azure, ADF (Azure Data Factory), Streamlit or alternatives. Excellent technical computing, analysis, design and development skills to a proven professional level. A good understanding of data modelling, ELT design patterns, data governance, and security best practices. A problem-solving mindset, curiosity, and adaptability - able to operate as a generalist across multiple data domains A strong background in delivering using cloud-based Microsoft Azure Data and Analytics capabilities, Microsoft DevOps and Agile delivery Experience...

Data Engineer - Outside IR35 - Contract - SC ESSENTIAL   A rare opportunity to join our fast-growing technology company selling high-value software development services. You will be working within a Government department as part of an existing team to support the rollout of a new Database.   Must have   Several years' experience with data modelling, data mapping, and defining data standards Experience working with complex, multi-organisation data landscapes Track record of delivering clarity in the presence of ambiguity Experience working with senior stakeholders to define strategy   Nice to have   Experience working with central and/or local government Familiarity with housing / property / regulatory datasets Experience implementing data standards that have already been defined   Your approach   You are passionate about delivering great technical quality, whether...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+ years...

Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and user-centred digital solutions that create real impact. Active SC clearance is a mandatory, non-negotiable requirement. Candidates must hold current, in-date Security Check (SC) clearance at the time...

EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect.   We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com .   Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+...

We are seeking an experienced Data Engineer to join our Group Technology team on a 9-month contract. You’ll play a key role in delivering Connells Group Reporting Data, covering medallion architecture, data modelling, design, and pipelines. You’ll work closely with technical specialists to innovate, share ideas and continually enhance team capability. Your work will support strategic decision-making across the Group by delivering accurate, timely reporting for all brands and business units. We offer a hybrid working arrangement with 1 day per week in our Milton Keynes office. Key Responsibilities Apply best practices for data design, ensuring scalable, high-quality and consistent architecture and modelling. Provide timely and accurate root-cause analysis and resolution within SLA timeframes. Work with the Core Data Lead to build common data models for unified customer and property data. Collaborate with Enterprise Data Architect to define,...

Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule. We are looking for a proficient Data Engineer to help advance AI development. As a member of DataAnnotation’s coding team, you’ll be part of a growing community of over 100,000 professionals — including front-end, back-end, full-stack, machine learning, and other engineers — who are driving real-world impact in AI development. Our platform offers an engaging blend of flexibility and challenge: you’ll work closely with state-of the art AI models to take on programming tasks that include creating and solving challenging coding problems, building beautiful apps with rich functionality, and synthesizing insights through data analysis and visualization. Your work directly contributes to refining intelligent systems that learn, adapt, and evolve. Some team members fit this work alongside a...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+ years...

£450 – £475 Inside IR35 City Newcastle upon Tyne Province Tyne and Wear Country United Kingdom Postal Code NE1 Job Description Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build...

MAKE STRATEGY A REALITY | ACCELERATE YOUR GROWTH | CHOOSE YOUR PATH As the world's leading change and transformation consultancy, we're helping businesses move from strategy to reality by taking a pragmatic and practical approach to build solutions that last. We're seeking a CRM Data Engineer in Farnborough to help us take vision to value and create lasting impact. Summary As a CRM Data Engineer, you will play a crucial role in optimizing our client's customer data management and integration processes. Your expertise in Oracle, PL/SQL, and RESTful API development will be instrumental in ensuring seamless data flow and synchronization across the organization's complex IT ecosystem. You Will Develop and execute complex Oracle SQL queries to extract, analyze, and present customer data insights to the business Identify and address integration gaps between multiple systems, implementing strategies to overcome data synchronization challenges Create and maintain...

We are seeking an experienced Data Engineer to join our Group Technology team on a 9-month contract. You’ll play a key role in delivering Connells Group Reporting Data, covering medallion architecture, data modelling, design, and pipelines. You’ll work closely with technical specialists to innovate, share ideas and continually enhance team capability. Your work will support strategic decision-making across the Group by delivering accurate, timely reporting for all brands and business units. We offer a hybrid working arrangement with 1 day per week in our Milton Keynes office. Key Responsibilities Apply best practices for data design, ensuring scalable, high-quality and consistent architecture and modelling. Provide timely and accurate root-cause analysis and resolution within SLA timeframes. Work with the Core Data Lead to build common data models for unified customer and property data. Collaborate with Enterprise Data Architect to define,...

Join the DataAnnotation team and contribute to developing cutting-edge AI systems, while enjoying the flexibility of remote work and setting your own schedule. We are looking for a proficient Data Engineer to help advance AI development. As a member of DataAnnotation’s coding team, you’ll be part of a growing community of over 100,000 professionals — including front-end, back-end, full-stack, machine learning, and other engineers — who are driving real-world impact in AI development. Our platform offers an engaging blend of flexibility and challenge: you’ll work closely with state-of the art AI models to take on programming tasks that include creating and solving challenging coding problems, building beautiful apps with rich functionality, and synthesizing insights through data analysis and visualization. Your work directly contributes to refining intelligent systems that learn, adapt, and evolve. Some team members fit this work alongside a...

Job Description: EXL (NASDAQ: EXLS) is a global data and artificial intelligence ("AI") company that offers services and solutions to reinvent client business models, drive better outcomes and unlock growth with speed. EXL harnesses the power of data, AI, and deep industry knowledge to transform businesses, including the world’s leading corporations in industries including insurance, healthcare, banking and financial services, media and retail, among others. EXL was founded in 1999 with the core values of innovation, collaboration, excellence, integrity and respect. We are headquartered in New York and have more than 60,000 employees spanning six continents. For more information, visit www.exlservice.com . Role: GCP Data Engineer (DBT, Cloud Composer, Python, Terraform) BU/Segment: Banking / Analytics Location: Edinburgh, United Kingdom (Flexible hybrid working) Employment Type: Umbrella Contract (Inside IR35) to start ASAP Experience: 10+ years...

Date Opened 29/04/2026 Job Type Contract Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and user-centred digital solutions that create real impact. Active SC clearance is a mandatory, non-negotiable requirement. Candidates must hold...