When message symbols have unequal probabilities, the cost of transmission can be compressed to a precise mathematical limit.