WoolyAI

A new inference stack for DGX Spark clusters achieves 55-90 tok/s on large models without speculative decoding, according to internal tests by WoolyAI. The stack enables multi-model agentic workflows …

WoolyAI released a new private multi-agent inference server for DGX Spark clusters, achieving up to 90.83 decode tokens per second on the Nemotron 3 Nano Omni 30B model without quantization or specula…