That all depends on what you ask it to do. I have 2 32GB B70’s in a PCIE 5.0 x8/x8 configuration, as well as an RTX 2000ADA in a lower PCIE 4.0x4 PCIE slot connected via the chipset.
The biggest difference for me- when I went from 1 card to 2, was that I switched to an 8 bit Quantization that has served me far better- with accuracy and reliability, I have also added additional models for speculative decoding, language, vision, embeddings, and more- although some of those do still live on the RTX 2000.
In terms of speed, I changed my inference engine when I added a second card- and that with the bigger memory pool, has increased speeds by around 20%, I also have increased context to something like 327k- which is plenty for a single end user.
Overall, the 32 to 64GB jump (or 80GB in my case) is about quality of life more than anything else, It gives you the headroom for more creative configurations and to try and add helpers where it might benefit your work- that all depends on your workload.