Senior Data Engineer at VCCP, London/Remote, £Contract Rate

Contract Description

Posted
4 hours ago
 
Checked
4 hours ago
 

Skills & Experience

Job roles: Data Engineer
Experience level: Senior
Core skills considered: Python, SQL, APIs, CI/CD, Data Pipelines
Other skills considered: Data Architecture, Data Modeling, Automated Testing, Git

Logistics

Base salary: Undisclosed
Employment type: Freelance/Contract
Remote working: Hybrid (up to 2 remote days p/w)
Visa sponsorship: Not available

Job Description

VCCP is looking for an exceptionally sharp, hands-on Senior Data Engineer to join us on a contract basis to help architect and build our core data platform capabilities. The successful candidate must be able to start immediately.

This is a senior, execution-focused role requiring a candidate who can hit the ground running immediately. You will take ownership of building robust, scalable data infrastructure using Microsoft Fabric, driving high engineering standards across data ingestion, transformation, CI/CD, and dev process automation.

This role is a job share with another Senior Data Engineer who works 2 days per week, therefore this role is part time = 3 days per week (Tuesday, Wednesday & Thursday).


Key Responsibilities

  • Architect, build, and optimise scalable data pipelines and platform components within Microsoft Fabric.
  • Design and implement robust data ingestion pipelines across a wide variety of sources, including REST APIs, database connectors, event streams, and batch feeds.
  • Establish and maintain modern development processes, including Git workflows, automated testing, and CI/CD deployment pipelines for data artifacts.
  • Write clean, modular, and optimized production code in Python and SQL to handle complex data processing tasks efficiently.
  • Enforce high code quality, data modeling standards, monitoring, alert setups, and documentation across the data lifecycle.

Core Requirements and Technical Skills

  • Deep, practical experience building production-grade solutions within the Microsoft Fabric ecosystem (OneLake, Lakehouses, Warehouses, Pipelines, Data Factory, Dataflows).
  • Advanced, expert-level proficiency in Python (PySpark, Pandas, API orchestration) and complex analytical SQL.
  • Extensive experience ingesting data from varied source systems via REST/GraphQL APIs, webhooks, databases, and flat files.
  • Hands-on experience setting up CI/CD pipelines (Azure DevOps, GitHub Actions, or similar), automated testing frameworks, and version control best practices for data teams.
  • Proven track record of designing data platforms from early stage through to production delivery.

Nice to Have Skills

  • Prior experience with GCP data tools (BigQuery, Cloud Storage, Dataflow) is advantageous, though not mandatory.
  • Previous exposure to marketing, advertising, or media agency data ecosystems.