You might want to read "The TTY demystified":
http://www.linusakesson.net/programming/tty/index.php
If you're on Linux and using a text console (Ctrl-Alt-F1 etc), IIRC the characters are rendered by the VGA card.
If you're using a terminal emulator like xterm or iTerm, it's different, but I don't know the answer.