| |||||||||||| 1 point by | Wondering if anyone has played around with the Strix Halo based systems with 128GB of unified memory for local AI, and what their experience has been so far in running different models:
- Practical limit on number of parameters x quantization
- What you've been using it for
- Which models and inference engines combine well | ||||||||||| Applications are open till July 27. |
source & further reading
news.ycombinator.com — original article
WorkOS reports security breach
I indexed 37h of my YouTube library using an RTX 4090 and local ML models in 24h
Anthropic's Mythos-class model allegedly leaked on Hugging Face