images

Definition

Image data. Two treatments dominate: convolutional, building up from local neighborhoods, and patch-based, cutting the picture into fixed tiles fed to a transformer as a token sequence. The underlying tension is that images have no natural discrete unit the way text has words, so how to segment and represent them is itself a modeling decision rather than something the data hands you.

Explainers using this term

• Paper Explained: Mi-Ripple — Diagnose First, Then Repair the Ripple That Iterative AI Editing Leaves BehindMi-Ripple: Restoring Images Degraded by Iterative AI Editing

In the textbook

• ViT — Treating Images Like Words
• CLIP — Words and Images on One Map