| |||||||||||| 1 point by | Wondering if anyone has played around with the Strix Halo based systems with 128GB of unified memory for local AI, and what their experience has been so far in running different models:
- Practical limit on number of parameters x quantization
- What you've been using it for
- Which models and inference engines combine well | ||||||||||| Applications are open till July 27. |
source & further reading
news.ycombinator.com — original article
Ask HN: Is there legal risk in AI memory?
Tell HN: Our paid Claude AI subscription unavailable >1 week and no support
Ask HN: What do you use local models for?