Qwen 7B

A developer reports that running Qwen2.5-Coder-32B via Ollama in VS Code caused 2-3 second latency, fixed by switching to the q4_K_M quantized version and setting num_ctx to 16384, improving response …

PrismML's 1-bit quantized Bonsai 27B model, weighing 3.9 GB, runs on a consumer GPU with an NVIDIA GeForce RTX 5060, achieving 10-20 tokens per second on average, but slower than smaller models like Q…

Karma Electric, a Buddhist AI research group, reports that training language models to reason about suffering rather than memorize refusal patterns yields safety that persists even when compliance neu…