Communication, Codes and Cyphers

These are notes for the course "Communications, Codes and Cyphers", first taught in Spring 2002.

Table of Contents

• 1. Introduction
  • 1.1 Shannon's Model
  • 1.2 Examples
    • Morse Code
    • ASCII
    • ISBN
    • Substitution Cypher
  • 1.3 Mathematical Basics
    • Logarithms
    • Modulo Arithmetic
    • Conditional Probability
• 2. Codes
  • 2.1 Instantaneously Decipherable Codes
  • 2.2 Decision Trees
  • 2.3 Kraft's Inequality
    • Proof
  • 2.4 Huffman Codes
• 3. Information Theory
  • 3.1 Entropy: Measuring Uncertainty

Change Log

6/2/02: Started Log. Added Chapter 3 preliminary version and Section 2.4.