Hacker News new | past | comments | ask | show | jobs | submit login Ask HN: What does your local LLM setup looks like? 2 points by the-mitr 23 minutes ago | hide | past | favorite | discuss What models and hardware you are using? For what purpose? What were the challenges? Any tricks that helped you in doing this? This might help new users like me setup theirs. help Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact Search:
A new inference engine to run Kimi K3 2.78T parameter with 29GB of RAM