Logits

Appears in 1 paper

Raw, unnormalised scores output by a neural network before applying softmax.

As used in Paper 07 — Neural Machine Translation by Jointly Learning to Align and Translate →

Raw, unnormalised scores output by a neural network before applying softmax. The alignment scores eₜᵢ are logits — they can be any real number. After softmax, they become proper probabilities (attention weights).