Hidden size / embedding dimension
How wide each token's internal representation is; bigger = more capacity, memory, compute.
How wide each token's internal representation is; bigger = more capacity, memory, compute.
How wide each token's internal representation is; bigger = more capacity, memory, compute.
How wide each token's internal representation is; bigger = more capacity, memory, compute.