Async inference in practice: a video-indexing service on Ray Serve
Ray Serve's async inference feature was used to build a video-indexing service that returns a task ID immediately and processes videos in the background, with the IndexingIngress deployment enqueuing …