Data Scientist
On-site
United Kingdom
Job Summary
The Data Engineer is responsible for integrating CDS source systems into the AI platform — building the connectors and ingestion pipelines that get source-system data flowing into the platform reliably.Key Responsibilities
Key Responsibilities: Build source-system integrations (webhooks → API Gateway/Lambda → EventBridge → SQS) Implement watermark/state tracking (DynamoDB) and periodic reconciliation to catch webhook delivery gaps without placing polling load on source systems Onboard new CDS source systems onto the platform's ingestion pattern as scope expands (e.g. Confluence, JIRA, and others across the CDS estate) Handle data migration activities where a source system needs backfilling into the platform (e.g. AWS DMS) Work with Knowledge Engineers to ensure ingested data meets the quality/structure neSkill Requirements
Other Requirements
Source: the employer's careers page. Last checked 2026-10-13. Posted 2026-10-13.
More jobs at HCLTech · On-site jobs in United Kingdom · Data jobs