Check out Code: The Hidden Language of Computer Hardware and Software by Charles Petzold for a slightly romantic take, or Malvino's Digital Computer Electronics for an undergraduate view of computer architecture.