Memory-bound
Limited by data-movement speed (cores idle, waiting for data).
Limited by data-movement speed (cores idle, waiting for data). Decode is memory-bound — the single most important performance fact in serving.
Limited by data-movement speed (cores idle, waiting for data).
Limited by data-movement speed (cores idle, waiting for data). Decode is memory-bound — the single most important performance fact in serving.