Development of Information Theory

Shannon defined information as reduction of uncertainty. Bit is the fundamental unit. Entropy measures information content and compression limits.