Feed-forward network / MLP
The per-token processing part of a layer; holds many parameters.
The per-token processing part of a layer; holds many parameters.
The per-token processing part of a layer; holds many parameters.
The per-token processing part of a layer; holds many parameters.