Dependency tree of the field
The map showing how every technique traces back to a few root facts (token-by-token generation; separate GPU compute/memory; memory-bound decode and the KV cache).
The map showing how every technique traces back to a few root facts (token-by-token generation; separate GPU compute/memory; memory-bound decode and the KV cache).