JA EN
Glossary › relative

GLOSSARY

relative

appears in 1 paper titles

Definition

Encoding something as a difference from a reference rather than as an absolute value. The important case is position: absolute schemes give each token an index, while relative schemes encode only the distance between pairs of tokens. That distinction drives generalization, since a model that only ever sees offsets has a better chance of handling sequences longer than those it was trained on.

Explainers using this term