simple

Definition

A claim that the method has few moving parts, few assumptions, or a short implementation while matching more elaborate baselines. In this field simplicity counts as a genuine contribution, because simple methods are easier to reproduce, tune, and build on. The thing to verify is whether the baselines were tuned as carefully as the proposed method — many "simple beats complex" results hinge on exactly that.

Explainers using this term

• Paper Walkthrough: SAS — Training a Sparse-Attention Block Selector End-to-End With the Language Modeling LossSAS: Simple Attention Sparsification via End-to-End Optimization of Context Ranking
• Paper Walkthrough: WHALE — Training the Weights and the Harness in TurnsWHALE: A Simple Recipe for Joint Harness-Weight Optimization
• Self-Supervised Learning — The Day Unlabeled Data Became an AssetA Simple Framework for Contrastive Learning of Visual Representations