File:Binaryerasurechannel.png · Wikimedia Commons · See Wikimedia Commons
information entropy
Sign in to saveAlso known as entropy, Shannon entropy, average information content, negentropy
expected value of the amount of information delivered by a message
Wikidata facts
- Subclass of
- physical quantity
Show 11 more facts
- facet of
- information
- opposite of
- negentropy
- discoverer or inventor
- Claude Shannon
- topic's main category
- Category:Entropy and information
- Commons category
- Entropy and information
- studied by
- information theory
- recommended unit of measurement
- nat
- on focus list of Wikimedia project
- Wikipedia:Vital articles/Level/4
- maintained by WikiProject
- WikiProject Mathematics
- P13411
- .xxx
- P1149
- Wikiversity
Sources (1)
via Wikidata · CC0
~40 min read
Encyclopedic overview
In information theory, the entropy of a random variable quantifies the average level of uncertainty or information associated with the variable's potential states or possible outcomes. This measures the expected amount of information needed to describe the state of the variable, considering the distribution of probabilities across all potential states. Given a discrete random variable
X
Excerpted from Wikipedia’s “information entropy” article, available under the CC BY-SA 4.0 licence.