Tensor Cores

Appears in 1 tutorial

Special GPU units that do low-precision matrix math (FP16/INT8/FP8) very fast; a reason quantization speeds compute.

As used in LLM Infrastructure →

Special GPU units that do low-precision matrix math (FP16/INT8/FP8) very fast; a reason quantization speeds compute.