Data Engineer at SS Technologies, Remote, from £400 per day

Data Engineer

We are building an enterprise-grade AI platform to enable secure, scalable and production-ready use of Generative AI and ML across the Program.

Skills Required (Mandatory):

· Building integrations against source-system APIs (webhooks, REST, event streams) — connecting various estate systems to the platform.

· Event-driven ingestion patterns — API Gateway/Lambda receivers, EventBridge, SQS per-consumer buffering
State/watermark tracking (DynamoDB) and reconciliation to catch delivery gaps

· Python for pipeline/integration development

· Data migration experience (e.g. AWS DMS) for onboarding new sources


Nice to have:

· Experience integrating with Confluence, JIRA, or similar enterprise collaboration/ITSM tool APIs

· Apache Airflow and/or dbt

· Enterprise security and governance awareness (regulated environments)

Key Responsibilities:

· Build source-system integrations (webhooks → API Gateway/Lambda → EventBridge → SQS)

· Implement watermark/state tracking (DynamoDB) and periodic reconciliation to catch webhook delivery gaps without placing polling load on source systems

· Onboard new source systems onto the platform's ingestion pattern as scope expands (e.g. Confluence, JIRA, and others across the estate)

· Handle data migration activities where a source system needs backfilling into the platform (e.g. AWS) Work with Knowledge Engineers to ensure ingested data meets the quality/structure needed for downstream graph population

· Maintain integration reliability — monitoring, error handling, and alerting on ingestion failures

Job Types: Temporary, Fixed term contract, Freelance

Pay: From £400.00 per day

Benefits:

• Work from home

Work Location: Remote