Semiconductor Device Fundamentals by Robert F. Pierret was my go-to for undergraduate text. The diagrams speak a thousand words and Pierret is a funny dude. Builds everything up from basic quantum.

Don't mistake it with his graduate text, Advanced Semiconductor Fundamentals, though. That's also a great text, but very short and focuses almost exclusively on the quantum aspect without getting too much into the higher level meat of putting it together to form devices.

For a comprehensive guide, though, Physics of Semiconductor Devices by Simon M. Sze was my reference bible. It's big and bulky, very heavy on the first principles math and physics, and has everything from quantum to devices and variants on devices.