17 data engineer jobs found

About Scrumconnect Consulting Scrumconnect Consulting is a people-focused digital consultancy delivering impactful solutions across the public and private sectors. We specialize in building high-performing, diverse, and inclusive teams that work on mission-critical digital transformation projects. As a Disability Confident employer and a company committed to continuous learning, we take pride in investing in our people and growing talent from the ground up.   Role Summary...

400-450 Inside IR35 City Newcastle upon Tyne Province Tyne and Wear Country United Kingdom Postal Code NE1 Job Description Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and...

400-450 Inside IR35 City Newcastle upon Tyne Province Tyne and Wear Country United Kingdom Postal Code NE1 Job Description Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and...

400-450 Inside IR35 City Newcastle upon Tyne Province Tyne and Wear Country United Kingdom Postal Code NE1 Job Description Apache Spark · Python · AWS · Cloud Data Pipelines A hands-on data engineering role within a large-scale cloud data programme, responsible for building, maintaining, and troubleshooting data pipelines using Apache Spark, PySpark, Apache Airflow, and a broad suite of AWS services. You will apply strong analytical and engineering skills to deliver trusted, well-governed data assets in a modern, cloud-native environment. About Scrumconnect Scrumconnect is a leading UK technology consultancy delivering digital transformation across public and private sectors, contributing to over 20% of the UK’s major citizen-facing public services. We specialise in cloud engineering, data platforms, and agile delivery, helping clients build scalable, secure, and...

400-500 Outside IR35 City London Province Greater London Country United Kingdom Postal Code EC1A Job Description About Scrumconnect Consulting Scrumconnect Consulting is a leading UK digital and technology consultancy specialising in delivering impactful, user-centred services for the public sector. We work with central government departments, agencies, and local authorities to build digital products and services that improve outcomes for citizens. With a team of engineers, architects, delivery professionals, and designers, we bring deep expertise in digital transformation, cloud technologies, and agile delivery. We are committed to engineering excellence, innovation, and creating an inclusive environment where everyone can thrive. Role Overview We are seeking an experienced Azure Solution Architect to design, architect, and deliver scalable, secure, and high-performance cloud data solutions...

Azure Solution Architect (SC Cleared) London, United Kingdom | Posted on 05/06/2026 About Scrumconnect Consulting Scrumconnect Consulting  is a leading UK digital and technology consultancy specialising in delivering impactful, user-centred services for the public sector. We work with central government departments, agencies, and local authorities to build digital products and services that improve outcomes for citizens. With a team of engineers, architects, delivery professionals, and designers, we bring deep expertise in digital transformation, cloud technologies, and agile delivery. We are committed to engineering excellence, innovation, and creating an inclusive environment where everyone can thrive. Role Overview We are seeking an experienced  Azure Solution Architect  to design, architect, and deliver scalable, secure, and high-performance cloud data solutions on Microsoft Azure. This role requires deep expertise in ...

Job Summary We are seeking an experienced and highly skilled Lead Azure Databricks Engineer to join our dynamic team. The successful candidate will be responsible for designing, developing, and leading complex data engineering solutions within the Azure cloud environment. This role offers an exciting opportunity to work on cutting-edge data projects, optimise data workflows, and mentor junior team members. The ideal applicant will possess extensive expertise in Azure Databricks, big data processing, and cloud architecture, ensuring the delivery of scalable and efficient data solutions that support strategic business objectives. Duties Lead the design and implementation of large-scale data pipelines using Azure Databricks, ensuring optimal performance and scalability. Collaborate with cross-functional teams including data scientists, analysts, and software engineers to develop integrated data solutions. Architect and optimise cloud-based data workflows,...

400 - 450 Inside IR35 City Newcastle Province Shropshire Country United Kingdom Postal Code SY7 Job Description About Scrumconnect Consulting Scrumconnect Consulting is a multi-award-winning digital consultancy, recognised for delivering impactful and innovative technology solutions across UK government departments. Our work has positively influenced the lives of over 40 million UK citizens. We are passionate about user-centred design, agile delivery, and building digital services that make a real difference. Our teams work at the forefront of innovation, helping organisations transform and deliver high-quality, scalable solutions that truly matter.   Overview: We are looking for a highly skilled AWS DevOps / Data Engineer to design, build, and maintain scalable, resilient, and high-performing cloud-based data solutions. The ideal candidate will have strong DevOps expertise combined with data...

JOB DETAILS Minimum years of experience: 5 Detailed Job Description: NetBackup Administration – Deep understanding of Veritas NetBackup, including backup, recovery, and disaster recovery strategies. · Flex Appliance Management – Experience in deploying, configuring, and maintaining NetBackup Flex Appliances. · Access Appliance Management – Experience in deploying, configuring, and maintaining NetBackup Access Appliances. · Bash Scripting & Automation – Proficiency in Bash, Powershell, or Python scripts for automating backup tasks, log analysis, and system monitoring. · Containerization & Linux Administration – Familiarity with Docker-based NetBackup instances and Linux-based system management. · Networking & Storage – Knowledge of storage configurations, networking protocols, and troubleshooting connectivity issues. · Security & Compliance –...

Experience / Competences Proficiency in writing database queries using SQL and general understanding of relational databases, and in data pipeline design and development. Experience with ETL processes, familiarity with the AWS ecosystem e.g. S3, Glue, DMS, CLI, etc., and experience with tools such as Qliksense, PowerBI, or equivalent. Ability to setup database connections and manage related issues. Familiarity with data analysis on trading platforms to understand order and trade lifecycle events. Be able to work through, with completeness and accuracy, a technical checklist of data validation and feed the results back to the Data Lead Be able to understand the reconciliation approach of order and order event count matching and use analysis techniques to identify differences and their cause. Self-starter, strong problem solver and great attention to detail. Excellent written and verbal communication. Adaptable, resilient, and a forward thinker....

Required Skills & Qualifications · Technical Expertise o Hands-on experience with ServiceNow CMDB and ITSM modules. o Strong knowledge of automation tools (Ansible, Terraform, Puppet, Chef). o Proficiency in scripting languages (Python, PowerShell, Shell). o Familiarity with CI/CD tools (Jenkins, GitLab, Azure DevOps). o Experience with cloud platforms (AWS, Azure, GCP). · Process Knowledge o Solid understanding of ITIL processes , especially Configuration, Change, and Incident Management. o Experience in integrating CMDB with monitoring and discovery tools. · Soft Skills o Strong analytical and problem-solving skills. o Excellent communication and stakeholder management abilities. o Ability to work in cross-functional teams and manage multiple priorities. Preferred Qualifications ServiceNow Certified Implementation Specialist (CIS) – CMDB. ITIL v4 Foundation certification....

Must have skills: Demonstrable experience with Solidity. Strong understanding of blockchain security practices and potential vulnerabilities. Proficiency in Hardhat and Foundry. Experience with Solidity security testing tools like Slither, Mythril, Echidna Practical experience with scripting languages like Javascript or Typescript. Ability to craft unit, integration, fork, and invariant tests, ensuring code longevity. Demonstrable aptitude for best development practices, data structures, algorithms, and methodologies. Bachelor's degree in Computer Science, Engineering, or a related STEM discipline. Excellent debugging and troubleshooting skills. Strong written and verbal communication skills. Self-motivated with the ability to work in a fast-paced, evolving environment. Proficient communication skills in English. Development background in sectors such as banking, finance, or trading, paired with a comprehensive grasp of financial...

JOB DETAILS Minimum years of experience: 5 Detailed Job Description: NetBackup Administration – Deep understanding of Veritas NetBackup, including backup, recovery, and disaster recovery strategies. · Flex Appliance Management – Experience in deploying, configuring, and maintaining NetBackup Flex Appliances. · Access Appliance Management – Experience in deploying, configuring, and maintaining NetBackup Access Appliances. · Bash Scripting & Automation – Proficiency in Bash, Powershell, or Python scripts for automating backup tasks, log analysis, and system monitoring. · Containerization & Linux Administration – Familiarity with Docker-based NetBackup instances and Linux-based system management. · Networking & Storage – Knowledge of storage configurations, networking protocols, and troubleshooting connectivity issues. · Security & Compliance –...

Required Skills & Qualifications · Technical Expertise o Hands-on experience with ServiceNow CMDB and ITSM modules. o Strong knowledge of automation tools (Ansible, Terraform, Puppet, Chef). o Proficiency in scripting languages (Python, PowerShell, Shell). o Familiarity with CI/CD tools (Jenkins, GitLab, Azure DevOps). o Experience with cloud platforms (AWS, Azure, GCP). · Process Knowledge o Solid understanding of ITIL processes , especially Configuration, Change, and Incident Management. o Experience in integrating CMDB with monitoring and discovery tools. · Soft Skills o Strong analytical and problem-solving skills. o Excellent communication and stakeholder management abilities. o Ability to work in cross-functional teams and manage multiple priorities. Preferred Qualifications ServiceNow Certified Implementation Specialist (CIS) – CMDB. ITIL v4 Foundation certification....

Must have skills: Demonstrable experience with Solidity. Strong understanding of blockchain security practices and potential vulnerabilities. Proficiency in Hardhat and Foundry. Experience with Solidity security testing tools like Slither, Mythril, Echidna Practical experience with scripting languages like Javascript or Typescript. Ability to craft unit, integration, fork, and invariant tests, ensuring code longevity. Demonstrable aptitude for best development practices, data structures, algorithms, and methodologies. Bachelor's degree in Computer Science, Engineering, or a related STEM discipline. Excellent debugging and troubleshooting skills. Strong written and verbal communication skills. Self-motivated with the ability to work in a fast-paced, evolving environment. Proficient communication skills in English. Development background in sectors such as banking, finance, or trading, paired with a comprehensive grasp of financial...

JOB DETAILS Minimum years of experience: 5 Detailed Job Description: NetBackup Administration – Deep understanding of Veritas NetBackup, including backup, recovery, and disaster recovery strategies. · Flex Appliance Management – Experience in deploying, configuring, and maintaining NetBackup Flex Appliances. · Access Appliance Management – Experience in deploying, configuring, and maintaining NetBackup Access Appliances. · Bash Scripting & Automation – Proficiency in Bash, Powershell, or Python scripts for automating backup tasks, log analysis, and system monitoring. · Containerization & Linux Administration – Familiarity with Docker-based NetBackup instances and Linux-based system management. · Networking & Storage – Knowledge of storage configurations, networking protocols, and troubleshooting connectivity issues. · Security & Compliance –...

Required Skills & Qualifications · Technical Expertise o Hands-on experience with ServiceNow CMDB and ITSM modules. o Strong knowledge of automation tools (Ansible, Terraform, Puppet, Chef). o Proficiency in scripting languages (Python, PowerShell, Shell). o Familiarity with CI/CD tools (Jenkins, GitLab, Azure DevOps). o Experience with cloud platforms (AWS, Azure, GCP). · Process Knowledge o Solid understanding of ITIL processes , especially Configuration, Change, and Incident Management. o Experience in integrating CMDB with monitoring and discovery tools. · Soft Skills o Strong analytical and problem-solving skills. o Excellent communication and stakeholder management abilities. o Ability to work in cross-functional teams and manage multiple priorities. Preferred Qualifications ServiceNow Certified Implementation Specialist (CIS) – CMDB. ITIL v4 Foundation certification....