×

Introduction to information theory and data compression. 2nd ed. (English) Zbl 1030.94021

Discrete Mathematics and its Applications. Boca Raton, FL: Chapman and Hall/CRC. xi, 366 p. (2003).
This is the second edition of the book. When compared to the first edition [Zbl 0903.94001], the authors have introduced some minor changes. They have reorganized Chapter 2 – “Information and entropy” – putting emphasis on Shannon’s works, e.g. Shannon’s quantification of information. Chapter 3 is also slightly modified. The authors have added a new part on the capacity of \(n\)-any symmetric channels. In turn, in Chapter 4, a new Section on “The information rate of a code” has been appended.
The book covers most of the elementary problems related to both information theory and data compression. The authors give the basic definitions and theorems from both areas – explaining their meaning through practical exercises. The reader can find fundamentals of the theory of probability, information theory – including definitions of information, entropy, channel models and channel capacity bounds, coding theory – with Shannon’s theorem and the Kraft-McMillan inequality, lossless data compression schemes – consisting of Huffman’s, Fano’s and Shannon’s encoding schemes, as well as adaptive (e.g. Knuth’s and Gallager’s methods) and dictionary methods.
The book also gives certain, however very limited, information on transformation methods and image compression algorithms (JPEG).
More advanced pieces of information are attached in the form of appendices. The appendices also include notes on and solutions to some exercises. All of this makes the book a useful compendium of fundamental knowledge on information theory and data compression principles.

MSC:

94A15 Information theory (general)
68P25 Data encryption (aspects in computer science)
94-01 Introductory exposition (textbooks, tutorial papers, etc.) pertaining to information and communication theory
94A40 Channel models (including quantum) in information and communication theory
94A24 Coding theorems (Shannon theory)
68-01 Introductory exposition (textbooks, tutorial papers, etc.) pertaining to computer science
94A29 Source coding

Citations:

Zbl 0903.94001