SQ (Scalar Quantization)
Store numbers as int8 instead of float32.
Store numbers as int8 instead of float32. ~4× smaller, tiny accuracy loss. Easy first win.
Store numbers as int8 instead of float32.
Store numbers as int8 instead of float32. ~4× smaller, tiny accuracy loss. Easy first win.