Kullback-Leibler divergence

$D_{KL}(P\parallel Q)={\sum }_{x}P(x)\log (\frac{P(x)}{Q(x)})$, for two probability distributions $P,Q$.