FP32 / FP16 / BF16 / FP8 / INT8 / INT4

Number formats of 32/16/16/8/8/4 bits (= 4/2/2/1/1/0.5 bytes per parameter). FP16/BF16 are common serving baselines; the rest are quantized.