← Back to Learn Learn · 03

Entropy & information theory

How do we measure information versus noise? Shannon entropy defines the absolute limit of lossless data compression. Type anything below to measure its density in real time.

Live Shannon Entropy Calculator Type below to compute

—H (bits/char)

0unique characters

—compression bound

Probability Distribution Histogram p(x) Total: 0 chars

Character distribution bars appear as you type...