Meta released Llama 4 Scout and Llama 4 Maverick as open-weight, natively multimodal models using a Mixture-of-Experts architecture, with Scout capable of fitting on a single H100 when quantized to In…
AMD introduced ROCm AMD Infinity Context (ROCm AIC), a purpose-built KV cache storage tier for distributed inference on AMD Instinct GPUs, starting with MI300X and MI350 Series. ROCm AIC uses low-late…
Meta's Llama open-source AI models can run on hardware ranging from a MacBook to a data-center GPU, with the key constraint being memory capacity. An M2 Pro MacBook with 16GB can run 1B, 3B, and 8B pa…
Researchers at MIT CSAIL and Harvard SEAS developed Collaborative Battleship, a language-based testbed, and collected the BattleshipQA dataset from over 40 human games to study how AI agents ask quest…
Researchers at MIT CSAIL and Harvard SEAS used the game "Battleship" to test and improve how language models ask questions in uncertain environments. By implementing a Monte Carlo inference strategy t…
A developer abandoned attempts to make an AI website builder generate proper desktop layouts through prompt engineering after two weeks of failed iterations. The engineer found that large language mod…