Selfhosted AI Server

A forum user asked for recommended specs for self-hosted AI workloads with Odysseus, and a respondent said a 3090 Ti should suffice, noting that a Qwen3.8-27b quant fits in its VRAM and is a good small model, with context window size determining whether an AWQ or flat 4-bit quant fits.

AnHero https://forum.level1techs.com/u/AnHero 1 Hello, I’m new to self hosted AI workloads and wanted to know what the recommended specs for decent performance with something like odysseus. I currently have a 30090ti to spare but not sure if that’s gonna be enough. Thanks in advance 3090 Ti should do fine. A Qwen3.8-27b quant should fit in the VRAM on that and its a wickedly good small model. Whether you can fit an AWQ quant or a flat 4-bit depends on how large a context window you need. I haven’t fooled with Odysseus so I don’t know what it specifically needs.