EntityQ1364826· pop 11· linked from 39 articlesjoint entropySign in to savemeasure of information in probability and information theoryConnectionsrandom variableEntityinformation entropyEntityInternational Standard Book NumberEntityintegralEntitybitEntityinformation theoryEntityVenn diagramEntityprobability density functionEntityindependent eventsEntityquantum information scienceEntitymultivariate probability distributionEntityKullback–Leibler divergenceEntitymutual informationEntitychannel capacityEntityShannon–Hartley theoremEntityShannon's source coding theoremEntityNoisy-channel coding theoremEntityconditional entropyEntitysubadditivityEntityEntropy rateEntityCategoriesEntropy and information