JA EN
Glossary › sequence-level

GLOSSARY

sequence-level

appears in 3 paper titles

Definition

Treating a whole generated sequence as the unit of optimisation instead of scoring each token independently. Token-level cross-entropy only asks whether the next symbol matches the reference, which fits poorly with tasks judged on the finished output — translation quality, whether a proof is valid, whether code runs. Sequence-level objectives, including most RL rewards, score the completed string and push credit back over it.