File:Binaryerasurechannel.png · Wikimedia Commons · See Wikimedia Commons
information entropy
Sign in to saveAlso known as entropy, Shannon entropy, average information content, negentropy
expected value of the amount of information delivered by a message
Wikidata facts
Show 3 more facts
- Commons category
- Entropy and information
- P13411
- .xxx
- P1149
- Wikiversity
Sources (1)
via Wikidata · CC0
~40 min read
Article
In information theory, the entropy of a random variable quantifies the average level of uncertainty or information associated with the variable's potential states or possible outcomes. This measures the expected amount of information needed to describe the state of the variable, considering the distribution of probabilities across all potential states. Given a discrete random variable
X
Gallery (2)
Connections
diversity index
Entity
information content
Entity
International Standard Book Number
Entity
logarithm
Entity
entropy
Entity
Euler's number
Entity
random variable
Entity
statistical mechanics
Entity
lossless compression
Entity
Lempel–Ziv–Welch
Entity
Kullback–Leibler divergence
Entity
cross entropy
Entity
Shannon's source coding theorem
Entity
entropy coding
Entity
David J. C. MacKay
Entity
entropy
Entity
hartley
Entity
Motion estimation
Entity
prediction by partial matching
Entity
YouTube
Concept