The Code Book
Nearing the end of this, and for a book that's largely about math, it manages to be pretty engrossing. It's basically a rundown of the history of cryptography, and the author weaves technical explanations in with dramatic historical events remarkably well. Really gives you a feel for how much of history has hinged on a cipher.