us-east-1

A user reports intermittent HTTP 500 errors on a custom-handler Inference Endpoint for text embeddings (Llama-3.1-8B) since early morning on 2026-07-14, with approximately 70% of requests failing whil…

A data residency audit that verified all outbound requests terminated in Frankfurt missed that the provider's prompt cache, a separate system governed by different SLAs, stored prefixes in us-east-1. …