#loss-function

2 articles

01 ·Information Theory·FREE·9 min read Entropy and Cross-Entropy — Where the Loss Function Comes From The cross-entropy loss you write in every classifier wasn't handed down by decree. Starting from the idea of surprise, we walk a single path through entropy and cross-entropy to that familiar one-liner — and finish with why squared error is the wrong tool for the job. 02 ·Machine Learning Basics·FREE·8 min read Loss Functions and Optimization — How a Model Learns From Being Wrong Why MSE and cross-entropy have the shapes they do, what the gradient actually points at, and one step of gradient descent taken apart with equations, a draggable figure, and ten lines of numpy — divergence included.