The concepts of source, channel, rate of transmission of information. Entropy and mutual information. The noiseless coding theorem. Noisy channels; the coding theorem for fi nite state zero memory channels. Channel capacity. Error bounds. Parity check codes. Source encoding.