[Build] enrichment-services resilience

[moligarch]

Module

enrichment-services

Phase

P2

Design sketch / interfaces / contracts

• Implement a suite of resilience patterns for all external clients (gRPC/HTTP).
• Retries: Use exponential backoff with jitter.
• Timeouts/Deadlines: Enforce strict deadlines on all outbound requests.
• Bulkheads: Limit concurrent requests to any single dependency.
• Circuit Breakers: Automatically stop sending requests to a failing dependency.

Test Plan

• Inject faults into mock dependencies to verify that retries and circuit breakers are triggered correctly.
• Run chaos tests (e.g., killing a dependency) to measure the service's resilience.

Definition of Done

• README updated with resilience strategies and configuration.
• Perf baseline under failure conditions is recorded.
• SLOs & alerts for circuit breaker state are configured.
• Linked to milestone & project.