AnHero 1
Hello, I’m new to self hosted AI workloads and wanted to know what the recommended specs for decent performance with something like odysseus. I currently have a 30090ti to spare but not sure if that’s gonna be enough. Thanks in advance!
3090 Ti should do fine. A Qwen3.8-27b quant should fit in the VRAM on that and its a wickedly good small model. Whether you can fit an AWQ quant or a flat 4-bit depends on how large a context window you need. I haven’t fooled with Odysseus so I don’t know what it specifically needs.