GPU utilization (and its trap)
A "GPU is busy" reading that can sit at 100% during memory-bound decode while compute is idle — so it's a misleading efficiency signal for LLMs.
A "GPU is busy" reading that can sit at 100% during memory-bound decode while compute is idle — so it's a misleading efficiency signal for LLMs.