#recurrent-state

1 articles

01 ·Time Series·★ MEMBER·PAPER·7 min read Paper Explained: STEPQuant — When and Where Quantization Errors Matter in Delta-Rule Recurrent States Linear-attention states have a fixed size, yet under concurrent serving they can outgrow the model weights. Naive low-bit quantization lets errors pile up with every update. STEPQuant spends bits and scales according to how long an error survives and which row it lands on. Explained from scratch.