66816

INTRODUCTION

Term of information is in our civilization so broad that it is impossible to expect a definition of the universal measure of information. In many domains, especially in (tale)communication. source of information. normally discrete data. and transmission channel arc dcscribed by thcir probabilistic models. For such niodcls. a niathcmatical theory callcd Information theory, developed in the late 40’s of the last century by C. E. Shannon, can be applicd. Fig.l I prcsents błock diagram of a communication system.

SOURCE

OF

INFORMATION

SOURCE

ENCODER

CHANNEL

ENCODER

MODULATOR

IT

CHANNEL

END USER		SOURCE		CHANNEL
OF	f—	DECODER		DECODER
INFORMATION			V—

Błock diagram of communication system

H

DEMODULATOR

The following blocks will be discussed in dctails: Source. Source + Channel Encoder. Channel. Channel Decoder. Then. all the considcrcd problems can be dividcd into two classcs.

Problems to be considered

1.    Source models and channel models.

2.    Encoding and decoding techniques.

a.    generał dcscription.

b.    detailed description of the selected (most important) techniques (codes).