Forward Pass
The computation that flows from input to output through the network: input → layer 1 → layer 2 → ...
The computation that flows from input to output through the network: input → layer 1 → layer 2 → ... → output → loss. During the forward pass, all intermediate values (activations) are computed and stored for use in the backward pass.