Students Professional
JA EN

#flat-minima

1 articles

01 ·Calculus & Optimization·★ MEMBER·PAPER·9 min read Convexity and Optimization — Why Deep Learning Works Even Though It Isn't Convex Optimization textbooks teach a stark divide: convex problems are solvable, non-convex ones come with no guarantees. So why does deep learning — whose loss surface is provably non-convex — work at all? From convex sets and functions to saddle points and flat minima, this article connects the whole story in the language of landscapes.