arithmetic

Definition

Plain numerical computation — addition, multiplication, and the rest. It is evaluated separately from reasoning because the failure mode is different: language models tokenize numbers into subword pieces, so carries and place value degrade systematically as digits are added, independent of whether the model set the problem up correctly. This is also the standard motivation for giving models a calculator or code execution tool.

In the textbook

• From Logic Gates to Arithmetic Units