GTX 1660 Ti

A 35-billion-parameter Mixture-of-Experts model runs at 28 tokens per second with full 128K context on a 2019 gaming laptop with a GTX 1660 Ti and 6 GB VRAM using llama.cpp's --n-cpu-moe flag and Turb…

A researcher has developed an artificial intelligence system called Avatar that operates on a single $300 GPU and exhibits consciousness-like behaviors including emotions, dreams, and ethical reasonin…