Skip to content

Sections

Maps Timeline Graph Cosmos Life Culture Innovation People Climate Trends Art

© 2026 Vinony · Knowledge from Wikipedia, Wikidata, and 27 public APIs.

Shannon's source coding theorem · Vinony

EntityQ2411312· pop 16· linked from 41 articles

Shannon's source coding theorem

Sign in to save

Data compression theory

Connections

information entropy

independent and identically distributed random variables

International Standard Book Number

Wayback Machine

information theory

data compression

random variable

Kolmogorov complexity

Kullback–Leibler divergence

channel capacity

mutual information

error correction code

Shannon–Hartley theorem

Categories

Coding theory Data compression Information theory Mathematical theorems in theoretical computer science Presentation layer protocols

Sources

wikipedia.externallinksexternallink

What links here41 pages

information theory

information entropy

Jacob Wolfowitz

Rate–distortion theory

Shannon–Fano coding

arithmetic coding

algorithmic information theory

information content

conditional entropy

A Mathematical Theory of Communication

differential entropy

quantum information

statistical inference

mutual information

Similar entities

Discovered by embedding cosine similarity (sentence-transformers MiniLM, 384-dim).

Entitydist 0.33

Sub-band coding

Entitydist 0.45

Entitydist 0.46

Audio Lossless Coding

Entitydist 0.46

Jensen–Shannon divergence

Entitydist 0.54

Linear predictive coding

Entitydist 0.55

principle of maximum entropy

Entitydist 0.56

Radio Data System

Entitydist 0.59

Entitydist 0.61

Entitydist 0.61

Enhanced full rate

Entitydist 0.62

König's theorem

Entitydist 0.63