#matrix-calculus

1 articles

01 ·Calculus & Optimization·★ MEMBER·11 min read Matrix Calculus from Scratch — Derive the Backward Pass Yourself Where does the transpose in ∂L/∂W = XᵀG actually come from? Matrix calculus is not a formula sheet to memorize — it is one move: rotate dX to the right inside a trace. From denominator layout and shape-checking to the gradients of a linear layer and softmax + cross-entropy, ending with a double-precision gradient check.