FP8
Modern 8-bit float, natively accelerated on the newest GPUs; memory savings + real compute speedup with small quality loss.
Modern 8-bit float, natively accelerated on the newest GPUs; memory savings + real compute speedup with small quality loss.