Students Professional
JA EN

#gemm

2 articles

01 ·Computer Architecture·★ MEMBER·PAPER·10 min read Systolic Arrays — Building the Heart of the TPU From Scratch Piling on multipliers doesn't make a chip faster, because moving data costs more than the arithmetic does. This piece takes the grid at the center of the TPU — the systolic array — and shows exactly how it maps the triple loop of matrix multiplication onto rows, columns and clock ticks, from a 2×2 hand trace to a cycle-accurate simulator to the batch-size and shape rules you'll actually tune. 02 ·Numerical Computing·★ MEMBER·8 min read The Cost of Matrix Multiplication — Where Almost All of AI's Compute Goes Why GEMM is everything: the anatomy of O(n³), memory bandwidth and arithmetic intensity, what actually makes a GPU fast, and the intuition behind tiling — ending with you able to estimate a model's training and inference FLOPs yourself.