Shannon information

The Shannon entropy is a measure of the average information content one is missing when one does not know the value of the random variable.