Data Engineer at Exception Ltd, Edinburgh, £Contract Rate

  • Contract Spy
  • Edinburgh, Scotland, UK
  • May 03, 2022
Duration not stated

Contract Description

Data Engineer - Cloud & Cyber Team - Contract

As part of our continued growth, we are looking for a Data Engineer to be part of our successful winning team. This role will be part of our Cloud & Cyber team which consists of several collaborative disciplines including development, DevOps, cloud architecture and engineering.This team works alongside other teams such as sales, service management, service design and architecture to deliver projects and services for our customers. This role will expand our creative and highly skilled team of consultants who have expertise in technical delivery, technologies and concepts in areas such as Data Storage, Data Ingestion, Data Integration, Data Warehousing and Data Preparation.

Experience Required

  • Strong cloud engineering experience with modern data technologies and services
  • Experience of working in multi-disciplinary teams to deliver data engineering elements of wider projects, programmes, and services
  • Skilled in languages such as SQL and Python (including PySpark)
  • Hands on experience of data technologies in cloud platforms such as Azure, AWS (Amazon Web Services) & GCP (Google Cloud Platform)
  • Experience working with data tools such as Spark (AWS Glue, EMR, Databricks,etc), Kafka (AWS Kinesis, Azure Event Hub, etc), Hadoop, Orchestration tools (Airflow, AWS Data Pipeline), Serverless functions (AWS Lambda/Step, Azure Functions).
  • Experience with varying data formats eg JSON, Parquet, Avro, CSV
  • Experience with requirements gathering, design, implementation of data migration solutions
  • Hand on experience with PowerBi
  • Experience working with both SQL and NoSQL foundational tools and databases such as MS SQL, PostgreSQL and MongoDB
  • Experience delivering solutions using key techniques such as Datamodelling (Star, Snowflake, Data Vault), Data warehousing, Lakes, ETL (Extract Transform Load), Virtualisation & Streaming
  • Takes ownership and accountability for critical initiatives and deliverables both internally and for clients
  • Awareness of current market trends in data having the ability to influence opinion and decisioning across the Data Management spectrum

Desirable

  • Experience of working in multi-disciplined agile teams utilising different development languages including Python, Java, Scala or Julia
  • Experience with microservices architecture
  • Experience in event driven data pipelines
  • Experience with CI/CD pipelines
  • Experience of AWS versions of data technologies such as Aurora, DynamoDB, Glue, RedShift and database migration services
  • AWS certification associate level (Developer, SysOps Administrator or Solutions Architect) or speciality (Database or Data Analytics)

If you are interested please apply or get in touch with the talent team at Exception.