£550 - £650 per day
Contract Spy
Remote (United Kingdom)
Data Engineer - AWS - Python - SQL - SC Eligible Data Engineer - AWS - Python - SQL - SC Eligible requirement for an urgent start. The Data Engineer - AWS - Python - SQL - SC Eligible will be working on a public sector AWS Data Platform. The Role:
Ingesting data from relational databases, file transfers and APIs into an S3-based data lake
Building ELT pipelines with dbt and Amazon Athena, using Apache Iceberg tables
Writing and scheduling workflows in Apache Airflow
Using Python for pre-processing, validation and automation, with tests in pytest
Managing infrastructure as code with Terraform, and shipping through GitHub Actions CI/CD
Building data quality checks so issues are caught before users see them
Helping analysts and data scientists find, understand and use the data you deliver
Keeping documentation current, so others can pick up your work
Data Engineer - AWS - Python - SQL - SC Eligible Key Skills:
Commercial experience...