I recently purchased an ebay Tesla V100s 32GB for LLM usage in llama.cpp
I power limited it to 200W, and have never exceeded 78C die temp.
Within a day of use, I got a hard crash and uncorrectable ECC errors. This event resulted in 32 retired pages. When I received the card, there were zero retired pages.
After this event, I ran the card through 2hrs of gpu_stress and got zero errors. I have been using it for a few more days with LLM workloads and have seen no further ECC errors in my kernel logs or nvidia_smi.
Should I return this card?
I don’t have enough experience with datacenter GPUs to know if I’m getting ripped off, and the product will degrade further.
I appreciate any insights.