38 data engineer jobs found

Full job description We are recruiting for a Contract Data Engineer for a contract to start ASAP. Day rate £500-550. Who We Are: AND Digital are a tech company focused on accelerating digital delivery and dedicated to closing the digital skills gap. We’ve been helping organisations build better digital products and stronger digital teams since 2014. We believe our work should always make a remarkable impact for our clients. We do this through our regional offices (or ‘Clubs’) building strong relationships with our partners, so that they are always prioritised by a team within close proximity. This unique model has driven success for our clients and ourselves, evidenced by our remarkable organic growth since 2014. Today we number more than 1,300 people with Clubs all over the UK, Europe and the USA with plans for global expansion in the next couple of years. Join us - and help us fulfil our mission to close the world’s digital skills gap....

Job Description: Location: Lisburn Contract Length: 3 Months (2-3 days per week) Rate: £500.00 per day Role: OKTO is seeking a Senior Data Engineer to lead the architecture and implementation of a mission-critical digital operations system for several major projects. This role is foundational to our mission – connecting diverse system endpoints such as power ,airflow, heating, medical gas and fire alarms into a centralised, resilient cloud-based infrastructure. You will be responsible for designing the end-to-end data lifecycle from high frequency time series ingestion to the creation of a “Master Dashboard” that ensures critical systems remain vital, accurate and trustworthy. Responsibilities: Data architecture & modelling: Design and implement a scalable architecture on Microsoft Azure to organise raw system data into curated, reporting-ready layers. Operational system integration: Build robust pipelines...

Job Description: Location: Lisburn Contract Length: 3 Months (2-3 days per week) Rate: £450.00 per day Role: OKTO is seeking a Senior Data Engineer to lead the architecture and implementation of a mission-critical digital operations system for several major projects. This role is foundational to our mission – connecting diverse system endpoints such as power ,airflow, heating, medical gas and fire alarms into a centralised, resilient cloud-based infrastructure. You will be responsible for designing the end-to-end data lifecycle from high frequency time series ingestion to the creation of a “Master Dashboard” that ensures critical systems remain vital, accurate and trustworthy. Responsibilities: Data architecture & modelling: Design and implement a scalable architecture on Microsoft Azure to organise raw system data into curated, reporting-ready layers. Operational system integration: Build robust pipelines...

You will join one of our high-performing consultant teams, delivering cutting-edge solutions for our financial services clients. This is a hands-on role where your data analysis skills and financial acumen will be essential to supporting senior business experts. You will be moving beyond the limitations of standard tools like Excel to solve complex data challenges. Working directly with critical data in the reinsurance domain, performing data crunching & providing actionable insights that inform key decisions. Key Responsibilities Perform complex data manipulation and analysis to support senior business experts and stakeholders. Utilise Python and its data libraries to handle large datasets and automate analytical tasks. Design and execute robust data mapping and analysis projects. Work with our expert teams to understand client needs and translate them into effective data solutions. Working in a fast paced start-up agile and high pressure environment....

You will join one of our high-performing consultant teams, delivering cutting-edge solutions for our financial services clients. This is a hands-on role where your data analysis skills and financial acumen will be essential to supporting senior business experts. You will be moving beyond the limitations of standard tools like Excel to solve complex data challenges. Working directly with critical data in the reinsurance domain, performing data crunching & providing actionable insights that inform key decisions. Key Responsibilities Perform complex data manipulation and analysis to support senior business experts and stakeholders. Utilise Python and its data libraries to handle large datasets and automate analytical tasks. Design and execute robust data mapping and analysis projects. Work with our expert teams to understand client needs and translate them into effective data solutions. Working in a fast paced start-up agile and high pressure environment....

Location: London/Hybrid (2-3 days on-site per week, remainder remote) Duration: 6 months + extension Clearance Requirement: Active SC (or SC-clearable with BPSS as a minimum) Rate: £500 per day (Inside IR35) SFIA 4 Overview We're seeking an SC cleared Senior Data Engineer to design, build, and operate data solutions that power mission-critical analytics within a complex UK public-sector environment. You'll lead on scalable, production-grade data pipelines on Microsoft Fabric (OneLake/Delta Lake, Data Factory, Synapse Data Engineering), using PySpark, Spark SQL, Python and SQL. You'll help modernise Legacy estates, mentor other engineers, and turn raw data into reliable, secure, and actionable intelligence for high-stakes decision-makers. This role is aligned to SFIA Level 4 (Enable) - ideal for an engineer who is hands-on, collaborative, and comfortable shaping standards and delivery across multiple squads. What you'll do Engineer production-grade...

You will join one of our high-performing consultant teams, delivering cutting-edge solutions for our financial services clients. This is a hands-on role where your data analysis skills and financial acumen will be essential to supporting senior business experts. You will be moving beyond the limitations of standard tools like Excel to solve complex data challenges. Working directly with critical data in the reinsurance domain, performing data crunching & providing actionable insights that inform key decisions. Key Responsibilities Perform complex data manipulation and analysis to support senior business experts and stakeholders. Utilise Python and its data libraries to handle large datasets and automate analytical tasks. Design and execute robust data mapping and analysis projects. Work with our expert teams to understand client needs and translate them into effective data solutions. Working in a fast paced start-up agile and high pressure environment....

Who are we: In 2019, our founders were working as engineers solving complex cross domain problems within government organisations TwinStream was formed to consolidate their collective expertise and experience into one business, providing technical excellence and exceptional service to their clients. We have teams working both on-site with clients and remotely from home.   Details : Employment: Contract (outside of IR35) Rate: £500 - £600 Security Level: Must have live DV- clearance Location: 5 days in either Cheltenham     About the role: Successful candidates will be working as part of an on-site team to maintain and support a managed cross-domain service using a wide range of technology, platforms and tools. The team employ site reliability engineering tools and practices to continuously verify and improve the service.     Responsibilities: Build and Deploy code from multiple...

Back End Engineer (Python & Azure) Delivering scalable data infrastructure that transforms manual financial and actuarial processes into automated, auditable workflows. To deliver robust, scalable backend systems and data infrastructure that power automated data pipelines and dashboards for financial services clients.   Requirements Hands On Experience:   Designing and implementing distributed, large-scale systems Architecting solutions from scratch across the full development lifecycle Working with event-driven architectures and data pipelines Building production Python applications with strong software engineering practices   Must Have:   Extensive production experience with Python including modern frameworks, testing, and deployment practices Proven experience designing and building distributed systems at scale Strong system architecture skills with ability to translate requirements...

iOS Engineer - Contract (Outside of IR35) As an iOS Developer, you will have the opportunity to build and lead solutions that engage millions of sports fans worldwide. Working with a wide range of data sources and native technologies, building bespoke UI experiences for sports fans. At Pulselive, we pride ourselves in providing a collaborative environment that ensures we produce leading products across web and native applications. Contractor Outside of IR35 Day Rate: £400 - £500 per day   Responsibilities Being a self-sufficient individual contributor, breaking down work into manageable pieces, calling out blockers and dependencies and delivering solution in a timely manner Managing code releases to internal environments (dev, test); may also need to manage code release to external environments (production) Producing code to a high standard that not only functions correctly but can be...

Experience / Competences Proficiency in writing database queries using SQL and general understanding of relational databases, and in data pipeline design and development. Experience with ETL processes, familiarity with the AWS ecosystem e.g. S3, Glue, DMS, CLI, etc., and experience with tools such as Qliksense, PowerBI, or equivalent. Ability to setup database connections and manage related issues. Familiarity with data analysis on trading platforms to understand order and trade lifecycle events. Be able to work through, with completeness and accuracy, a technical checklist of data validation and feed the results back to the Data Lead Be able to understand the reconciliation approach of order and order event count matching and use analysis techniques to identify differences and their cause. Self-starter, strong problem solver and great attention to detail. Excellent written and verbal communication. Adaptable, resilient, and a forward thinker....

Must have skills: Demonstrable experience with Solidity. Strong understanding of blockchain security practices and potential vulnerabilities. Proficiency in Hardhat and Foundry. Experience with Solidity security testing tools like Slither, Mythril, Echidna Practical experience with scripting languages like Javascript or Typescript. Ability to craft unit, integration, fork, and invariant tests, ensuring code longevity. Demonstrable aptitude for best development practices, data structures, algorithms, and methodologies. Bachelor's degree in Computer Science, Engineering, or a related STEM discipline. Excellent debugging and troubleshooting skills. Strong written and verbal communication skills. Self-motivated with the ability to work in a fast-paced, evolving environment. Proficient communication skills in English. Development background in sectors such as banking, finance, or trading, paired with a comprehensive grasp of financial instruments and systems. Bonus...

Back End Engineer (Python & GCP) Delivering scalable data infrastructure that transforms manual financial and actuarial processes into automated, auditable workflows. To deliver robust, scalable backend systems and data infrastructure that power automated data pipelines and dashboards for our global life reinsurance client in Bermuda. Hands On Experience: Building production Python applications with strong software engineering practices Designing and implementing distributed, large-scale systems Architecting solutions from scratch across the full development lifecycle Working with event-driven architectures and data pipelines Requirements Must Have: Exstensive production experience with Python including modern frameworks, testing, and deployment practices Proven experience designing and building distributed systems at scale Strong system architecture skills with ability to translate requirements into technical designs Familiarity...

Back End Engineer (Python & Azure) Delivering scalable data infrastructure that transforms manual financial and actuarial processes into automated, auditable workflows. To deliver robust, scalable backend systems and data infrastructure that power automated data pipelines and dashboards for financial services clients.   Requirements Hands On Experience:   Designing and implementing distributed, large-scale systems Architecting solutions from scratch across the full development lifecycle Working with event-driven architectures and data pipelines Building production Python applications with strong software engineering practices   Must Have:   Extensive production experience with Python including modern frameworks, testing, and deployment practices Proven experience designing and building distributed systems at scale Strong system architecture skills with ability to translate requirements into...

Who are we: In 2019, our founders were working as engineers solving complex cross domain problems within government organisations TwinStream was formed to consolidate their collective expertise and experience into one business, providing technical excellence and exceptional service to their clients. We have teams working both on-site with clients and remotely from home.   Details : Employment: Contract (outside of IR35) Rate: £500 - £600 Security Level: Must have live DV- clearance Location: 5 days in either Cheltenham   About the role: Successful candidates will be working as part of an on-site team to maintain and support a managed cross-domain service using a wide range of technology, platforms and tools. The team employ site reliability engineering tools and practices to continuously verify and improve the service.   Responsibilities: Build and Deploy code from multiple project teams:...

iOS Engineer - Contract (Outside of IR35) As an iOS Developer, you will have the opportunity to build and lead solutions that engage millions of sports fans worldwide. Working with a wide range of data sources and native technologies, building bespoke UI experiences for sports fans. At Pulselive, we pride ourselves in providing a collaborative environment that ensures we produce leading products across web and native applications. Contractor Outside of IR35 Day Rate: £400 - £500 per day   Responsibilities Being a self-sufficient individual contributor, breaking down work into manageable pieces, calling out blockers and dependencies and delivering solution in a timely manner Managing code releases to internal environments (dev, test); may also need to manage code release to external environments (production) Producing code to a high standard that not only functions correctly but can be...

Back End Engineer (Python & Azure) Delivering scalable data infrastructure that transforms manual financial and actuarial processes into automated, auditable workflows. To deliver robust, scalable backend systems and data infrastructure that power automated data pipelines and dashboards for financial services clients. Requirements Hands On Experience: Designing and implementing distributed, large-scale systems Architecting solutions from scratch across the full development lifecycle Working with event-driven architectures and data pipelines Building production Python applications with strong software engineering practices Must Have: Extensive production experience with Python including modern frameworks, testing, and deployment practices Proven experience designing and building distributed systems at scale Strong system architecture skills with ability to translate requirements into technical designs Familiarity with...

Experience / Competences Proficiency in writing database queries using SQL and general understanding of relational databases, and in data pipeline design and development. Experience with ETL processes, familiarity with the AWS ecosystem e.g. S3, Glue, DMS, CLI, etc., and experience with tools such as Qliksense, PowerBI, or equivalent. Ability to setup database connections and manage related issues. Familiarity with data analysis on trading platforms to understand order and trade lifecycle events. Be able to work through, with completeness and accuracy, a technical checklist of data validation and feed the results back to the Data Lead Be able to understand the reconciliation approach of order and order event count matching and use analysis techniques to identify differences and their cause. Self-starter, strong problem solver and great attention to detail. Excellent written and verbal communication. Adaptable, resilient, and a forward thinker....

Mid Back End Engineer (Python & GCP) Delivering scalable data infrastructure that transforms manual financial and actuarial processes into automated, auditable workflows. To deliver robust, scalable backend systems and data infrastructure that power automated data pipelines and dashboards for our global life reinsurance client in Bermuda. Hands On Experience: Building production Python applications with strong software engineering practices Designing and implementing distributed, large-scale systems Architecting solutions from scratch across the full development lifecycle Working with event-driven architectures and data pipelines Requirements Must Have: 4+ years production experience with Python including modern frameworks, testing, and deployment practices Proven experience designing and building distributed systems at scale Strong system architecture skills with ability to translate requirements into technical designs Familiarity...

Who are we: In 2019, our founders were working as engineers solving complex cross domain problems within government organisations TwinStream was formed to consolidate their collective expertise and experience into one business, providing technical excellence and exceptional service to their clients. We have teams working both on-site with clients and remotely from home.   Details : Employment: Contract (outside of IR35) Rate: £500 - £600 Security Level: Must have live DV- clearance Location: 5 days in either Cheltenham   About the role: Successful candidates will be working as part of an on-site team to maintain and support a managed cross-domain service using a wide range of technology, platforms and tools. The team employ site reliability engineering tools and practices to continuously verify and improve the service.   Responsibilities: Build and Deploy code from multiple project teams:...