COURSE: Information Theory 2005/2006


dr. Peter van Emde Boas


hours:   
Wednesday 13.15 - 15.--   Room P   017,
Thursday  09.30 - 11.00   Room  C  302

The "cruel"  early starting time at 9.15 may cause problems due to
traffic delays, particularly in bad weather (which is expected for the
next months anyhow - this is the Kingdom of the Netherlands).

In order to accomodate for this problem the Thursday classes will
start at 9.30 instead of 9.15, and we will have a short sanitary stop
instead of a regular break.

 


The Excercise page for the 2005 course now has been opened.



Scheme of classes:

Week   Wedensday                                            Thursday

06        Feb 08  Introduction                              Feb 09   Intro Probability Theory 
07        Feb 15  Entropy function                       Feb 16   Conditional Entropy, relative Entropy
08        Feb 22  Jensen Inequality                       Feb 23   The Log-sum inequality and its consequences                                           
09        Mar 01  2nd law of thermodynamics      Mar 02   Class canceled (funeral)                                          
10        Mar 08  Asymptotic equpartition prop.  Mar 09   Class canceled (Risk seminar)                                      
11        Mar 15  Markov Chains Entropy Rate   Mar 16   Random Walks on Graphs, Hidden Markov Chains                                       
12        Mar 22  Codes, Kraft Inequality            Mar 23   Optimal Codes, Shannon code                                     
13        Mar 29  No Class:  Exam Week             Mar 30  No Class:  Easter Exam week

14        Apr 05  Huffman Coding Scheme          Apr 06   Arithmetic codes                              
15        Apr 12  Class canceled (docent away)    Apr 13   
Class canceled (docent away)                                     
16        Apr 19  Intro Computation Theory       Apr 20   Kolmogorov Complexity
17        Apr 26  Universal Distribution              Apr 27   Universal distributrion and Kolmogorov Complexity   
18        May 03 Intro Coding Theory, Channels May 04   Class canceled (no show students)
19        May 10 Preparation Coding theorem    May 11    Class canceled (superflous slot)                                         
20        May 17 Finishing sections coding          May 18   
Class canceled (superflous slot)
21        May 24 No class (superfluous slot)         May 25 No Class; Assumption Day
22        May 31  No Class:  Exam week             Jun 01  No Class:  Exam week

 
Literature:  Thomas Corver and Joy A. Thomas, Elements of Information Theory, Wiley Series in telecommunications.


Excercises for chapters 2 - 8 will be selected and posted on the web.
The page with excercises can be found by following this link. This page is however not yet opened.

Please submit the excercises at your convenience by the end of the course year.
You can submit your solutions in my mailbox in the Euclid Building. Look under the V in the
alphabet.