Week7-1Noisy channel model

The noisy channel model

• Example:
  
  • Input: written English(X)
  • Encoder: garble the input(X->Y)
  • Output: spoken English(Y)
• More examples:
  
  • Grammatical english to english with mistakes
  • English to bitmaps(characters)
    $$P(X,Y) = P(X)P(Y|X)$$

Encoding and decoding

Example

A good translation will have both a high score of translation model and a high score of language model.

Uses of noisy channel model

• Machine translation
• Handwriting recognition
• Text generation
• Spelling correction