#eigenvalues

1 articles

01 ·Linear Algebra·FREE·7 min read The Linear Algebra Under LoRA and RAG — Eigenvalues, Low Rank and Vector Search, Hands On A matrix is a deformation of space, an eigenvector is a direction that survives it, SVD generalises the idea, and the dot product is the definition of 'similar'. Four interactive figures and four equations show that LoRA's ΔW=BA and RAG's vector search stand on the same floor. A column meant to be dragged, not just read.