#memory-wall

1 articles

01 ·Computer Architecture·FREE·9 min read The Memory Wall from Scratch — Why Moving Data Costs More Than Computing Multiplying two numbers is cheap; delivering them is not. Starting from the physics of charging a wire, we get to why DRAM latency never shrank, the orders of magnitude in the memory hierarchy, Little's law, machine balance and the roofline — and end with a procedure for deciding whether your kernel is compute bound or bandwidth bound.