Students Professional
JA EN

#cross-attention

2 articles

01 ·★ MEMBER·PAPER·15 min read Paper Walkthrough — The Missing Temporal Link: Putting Script Timing on the Video–Audio Axis with Temporal Context Routing Video and audio stay in sync with each other while both drift off the script's timeline. This walkthrough follows the paper's own equations and numbers to show how TCR closes that third, missing temporal link with a single additive term in the cross-attention logits. 02 ·CNNs & Image Recognition·★ MEMBER·PAPER·8 min read Paper Walkthrough: TurboVLA — Kick the LLM Out of the Loop and Run a Robot Policy at 32 Hz on an RTX 4090 with Under 1 GB of VRAM Mainstream VLA models route every control step through a large language model. TurboVLA removes the LLM and fuses vision and instructions with lightweight bidirectional cross-attention instead — hitting 97.7% on LIBERO with 0.2B parameters, 31.2 ms latency, and 0.9 GB of VRAM. A from-scratch walkthrough of the paper.