Foundation model
A large model pre-trained on broad data that can be adapted to many downstream tasks.
A large model pre-trained on broad data that can be adapted to many downstream tasks. Term coined later (2021) but GPT-1 was the first clear demonstration of the concept.