Glossary › lost
GLOSSARY
lost
appears in 2 paper titles
Definition
Ordinary English "lost", but it has a fixed home in long-context work: lost in the middle names the observation that models make good use of material at the start and end of a long input while under-using what sits between them. It is a claim about retrieval from context, not about exceeding the context window. Do not confuse it with loss, the training objective.