1.3 TB of RAM for 100M Vectors? Shrink Them Before They Hit OpenSearch
A developer detailed how pre-quantizing vectors before indexing into Amazon OpenSearch Service can cut the memory footprint of a 100-million-vector, 1,536-dimension index, which at full FP32 precision…