Contract Spy
United Kingdom
About the Role
We are seeking an experienced Azure Databricks & Airflow Engineer to join our Data Engineering team on a 6-month contract . The ideal candidate will have strong hands-on expertise in Data Engineering, Databricks, Apache Airflow, PySpark, Python, Unity Catalog, and Data Modelling , ideally within banking or financial services . The role involves designing, building, and optimizing scalable data pipelines, ensuring data governance, and enabling robust analytics and reporting capabilities.
Key Responsibilities
Develop and maintain data pipelines using Azure Databricks, Apache Airflow, PySpark, Python , and related Azure services.
Implement and manage Unity Catalog for data governance, lineage, access controls, and cataloging of datasets.
Design and optimize data models (Dimensional, Star, Snowflake schemas) for analytical reporting and data warehousing in financial environments.
Monitor, optimize, and troubleshoot...