Parameter / weight
One of the billions of tunable numbers inside a model that together encode what it "knows." More parameters = more memory and compute needed.
One of the billions of tunable numbers inside a model that together encode what it "knows." More parameters = more memory and compute needed.