Students Professional
JA EN

#entropy-coding

1 articles

01 ·Coding Theory·★ MEMBER·9 min read Entropy Coding from Scratch — From Huffman to Arithmetic Coding "Information content becomes code length" — that one line is all of compression. From Shannon's bound to building a Huffman code by hand, the integer-bit ceiling, the arithmetic coders and ANS that break it, and what is actually running inside JPEG, PNG, H.264 and zstd. Ending with how to diagnose a compression ratio that has stopped improving.