16:00
2026-08-18
anyscale.com
artificial-intelligence
Async inference in practice: a video-indexing service on Ray Serve
Ray Serve's async inference feature was used to build a video-indexing service that returns a task ID immediately and processes videos in the background, with the IndexingIngress deployment enqueuing …