This text was written using Google Translate.
I am not proposing that we equip cards with expensive AI-specific chips like HBM or HBF.
I currently use a 3060 OC.
I get frustrated every day due to a lack of memory.
Right now, consumer GPU prices refuse to drop because of HBM.
So, let’s try a different approach.
Let’s add an expansion slot to consumer GPUs.
We could install inexpensive memory into this slot.
Currently, the only option available to us is NVMe.
I am not proposing this for general PC storage expansion, like with the RTX 4060 Ti.
I want it to be used to expand that damn GPU memory.
It doesn’t even need to show up in Windows Device Manager or diskpart.
It would simply be used to load things like model caches.
The advantage is that memory is easy to acquire and can be swapped out based on the required model cache capacity.
The downside is that performance will vary depending on the NVMe module used.
I want an end to this situation where I can’t get an RTX 5060 Ti or better because of HBM.