Definition of Entropy
Since information associated with certainty is zero:
Entropy is defined as the expectation of I
Previous slide
Next slide
Back to first slide
View graphic version