I threw 1000+ LLM calls. Here is how VernLLM handled it.

A developer released VernLLM, an open-source MIT-licensed LLM call framework for TypeScript, and stress-tested it with over 1,000 LLM calls. The framework offers adaptive AIMD rate-limiting, advanced circuit-breakers, multi-provider fallbacks, and retries with budget and observability features.

VernLLM is the LLM call framework for TypeScript. This video tests out its features, which includes adaptive AIMD rate-limiting, advanced circuit-breakers, multi provider fallbacks, developed retries with budget and observability. Open source with MIT license. Website: https://vernllm.dev https://vernllm.dev GitHub: https://github.com/LakBud/vernLLM https://github.com/LakBud/vernLLM npm: https://www.npmjs.com/package/vern-llm https://www.npmjs.com/package/vern-llm