We used C++ throughout most of my CS program, and I hated it at the time and never wanted to write it ever again (and haven't!), but good lord did it help me understand how computers work. I've benefitted from that perspective ever since.

I'm not sure you have to do a whole degree to get that perspective, though. Just learning C or C++ should get you a good chunk of it.