parameters

Definition

The numbers inside a model whose values are set by training — weights and biases. Their count is the field's default size label, which is what 7B or 70B refers to, and it bounds both memory footprint and, loosely, capacity. Do not confuse them with hyperparameters such as learning rate or depth, which are chosen by hand before training and are not updated by gradient descent.