Tokenization

The process of converting input (text, images, audio) into discrete tokens. Gemini tokenizes all modalities identically into a unified vocabulary.

Splitting text into tokens (and detokenization is converting tokens back to text).