BatchDAG

A new architecture called BatchDAG reduces LLM API calls by up to 47x through entity-aware batching, enabling queries over 50,000+ meetings in under 60 seconds at $0.02–$0.24 each, according to a prep…

Brevian.ai's BatchDAG system, which uses an LLM to generate typed directed acyclic graphs of operations for ad-hoc analysis over enterprise data, achieves quality comparable to expert-designed pipelin…