Seior Data Engineer at Red Badger, London/Remote, 25th November Start, £Competitive Day Rate (Outside IR35)

Freelance Data Engineer

We are working with a large client - a blue chip price comparison website, offering multiple financial services companies access to new UK customers for a wide variety of financial products. We're working on a large initiative to transform the level of reporting capability across the business in the medium term. In the short term we require the assistance of a capable freelance Data Engineer to help us unlock key data and management information, and work with Red Badger to continue to develop a longer term strategic vision on a new data platform

• .
  Start date Monday 25th Novemb
• erOutside IR
• 35Hybrid working (2 days / week either at client offices or Red Badger offices by Old stree
• t)£competitive day ra

te
Technology &

• gt;
  Python, C#, or other relevant languages for data processing and
• ETL.Experience with big data tools: Hadoop, Spark, Kafka, and other big data technolog
• ies.Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassand
• ra).Cloud platforms: Experience with cloud platforms such as AWS, Azure, or Google Cloud, especially in using data-related services like Redshift, BigQuery, or Databri

cks.
Immediate Inter

views
We bring together the best in strategic services, user experience and technical delivery using Lean and Agile proc

esses.
Founded in 2010 by Stuart, Cain and David, we help large organisations improve their speed to market whilst focusing on delivering value to their users and customers. We work with our clients to understand their problems and validate ideas in order to deliver improved process efficiencies, strategic enhancements and new digital products and services (or make significant improvements to existing

ones).The best bit about Red Badger is, of course, the team. We’ve been around for 10+ years now and we are 120 strong. We are really proud of our people; we support and learn a lot from each other; we work really hard but have fun doing it. We are a diverse group made up of 22 different nationalities, speaking 17 different lan

guages.Our 3 founders have considerable tech and consultancy experience, and still own the company. We’ve been consistently profitable and have grown responsibly from the beginning. We are embarking on the next phase of growth and devel

opment.

The role
As a Data Engineer, you will design, build, and maintain scalable data pipelines and architectures to support our organisation's data processing needs. You will collaborate closely with data scientists, analysts, and other engineers to optimise data flow and collection for cross-functional teams. The ideal candidate is a technical expert in building and optimising large-scale data systems and can troubleshoot performance and reliability issues in big data envi

ronments.
Key Respon

• sibilities
  Develop and maintain data pipelines: Design and build robust, scalable, and efficient data pipelines for collecting, processing, and storing large datasets from vario
• us sources.Data integration: Integrate data from multiple data sources, including APIs, databases, flat files, and external platforms, ensuring consistent and high-quality data av
• ailability.Optimize data workflows: Identify and implement optimizations to improve data reliability, performance, and scalability. Automate manual processes, optimize data delivery, and design systems to scale as
• data grows.Maintain data architecture: Create and manage data models, schemas, metadata, and ETL processes to ensure consistency, efficiency, and data
• integrity.Database management: Manage and maintain databases, data warehouses (e.g., Amazon Redshift, Snowflake), and data lakes (e.g., AWS S3), ensuring high availability an
• d security.Collaborate with data teams: Work closely with data scientists, analysts, and stakeholders to ensure proper data infrastructure and meet data requirements for analytics, reporting, and machin
• e learning.Monitor and troubleshoot: Set up monitoring and logging systems to detect data issues, implement resolution protocols, and provide root cause analysis to resolve data flo

w problems.
You

r experience
It’d be great if y

• ou have > Proficiency in programming languages: Expertise in Python, C#, or other relevant languages for data proces
• sing and ETL.Experience with big data tools: Familiarity with Hadoop, Spark, Kafka, and other big data
• technologies.Database expertise: Strong knowledge of SQL and experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB
• , Cassandra).Cloud platforms: Experience with cloud platforms such as AWS, Azure, or Google Cloud, especially in using data-related services like Redshift, BigQuery, o
• r Databricks.Data modelling and schema design: Experience with creating and maintaining data models, database schemas, and ET
• L frameworks.Version control and CI/CD: Familiarity with Git and CI/CD pipelines for code deployment an
• d automation.Problem-solving and debugging: Strong analytical and troubleshooting skills, especially in optimising data systems a
• nd processes.Excellent communication: Ability to work effectively in teams and collaborate with technical and non-technical stakeholders to understan

d data needs.
It’d be amazing if you have

• also have >
  Hands-on experience with data pipeline orchestration tools like Apache Airflow or AWS
• Step Functions.Knowledge of data governance and data security
• best practices.Experience with data visualization tools like Tableau, Power

BI, or Looker.
Re

• d Badger Valu
• es:
  People peopleWe respect and care for each other, giving us the space to feel safe and b
• e our true
• selvesFind a wayWe’re comfortable with uncertainty and accountability, whilst achieving great outcomes thr
• ough shared goa
• lsAlways learningWe’re curious. It’s how we learn and grow as individuals, continuously testing and improving what we do,
• and how we do
• itOpen & FairWe build trust by telling things as they are, being open, and seeking to achieve fair and eq
• uitable outco
• mes.CollaborativeWe are united by our desire to get to the best ideas. We are generous with our knowledge, actively listen to each other, and

are open minded.
Diversit

y & Inclusion:
Red Badger is committed to creating a diverse and inclusive environment, and is proud to be an equal opportunity employer. We hire, employ, train, promote and compensate regardless of gender, gender identity, race, disability, sexual orientation, age, creed and colour. We are fully focused on equality, and it is our fundamental belief that the fascinating characteristics that make us all different enable us to continue to do amazing wo