EntityQ255166· pop 23· linked from 213 articlesKullback–Leibler divergenceSign in to savemeasurement of how one probability distribution is different from a second, reference probability distributionConnectionsinformation entropyEntityprobability distributionEntityinformation contentEntitylogarithmEntityrandom variableEntityexpectationEntityprobability spaceEntitymaximum likelihood estimationEntityabsolute continuityEntityprior probabilityEntitycross entropyEntityentropy codingEntityprinciple of maximum entropyEntityexponential familyEntityGibbs' inequalityEntityInformation gain in decision treesEntityInternational Standard Book NumberEntityPythagorean theoremEntityprobabilityEntityreal numberEntityCategoriesEntropy and informationF-divergencesInformation geometryThermodynamics