Senior Databricks Solutions Architect at Valcon Group, London, £800-£900 per day

We’re looking for a hands-on Senior Databricks Solutions Architect to support a complex, high-performance data platform within a global organisation.

You’ll design and optimise Spark workloads, build production streaming pipelines and deliver scalable Databricks solutions using Delta Live Tables, Workflows, Unity Catalog, Python, PySpark, Terraform and Databricks Asset Bundles.

Key requirements:

• Advanced Apache Spark and Spark SQL optimisation
• Production Spark Structured Streaming experience
• Deep Databricks platform knowledge
• Strong Python and PySpark engineering capability
• Delta Live Tables, Workflows and Unity Catalog
• Terraform and Databricks Asset Bundles
• CI/CD and GitHub Actions
• Ability to work autonomously in a fast-moving environment

Experience with Databricks Apps, Lakebase, Airflow, Azure Data Factory, monitoring platforms or financial services would be beneficial.

Location: London
Rate: £800–£900 per day
IR35: Inside IR35