> Holding `CTRL` essentially lops off the first three bits
No, it inverts the 7th bit (or subtracts 64).
The Linux `ascii(7)` man page has a similar table, but with 2 columns. The first 32 control characters listed there have their "caret notation" character in the opposite column.