kto

Definition

Kahneman-Tversky Optimization, an alignment method whose loss borrows the value function from prospect theory: gains and losses measured against a reference point, with losses weighted more heavily than equivalent gains. Its practical selling point is the data it needs. Unlike DPO it requires no matched winner/loser pairs, only a binary desirable/undesirable label per output — which is the shape of feedback most products already collect.