Yes, there's a multitude of USB-to-RS/232 adapters and Linux can easily be configured to echo a terminal to the serial port from boot onwards. Once you've got a serial console you can do whatever you want.

Depending on the terminal, you'll need to fiddle with baud rates, parity, and obviously hardware issues such as male/female connectors and number of pins. It took me quite a while to get my VT100-compatible terminal talking to my RaspberryPi3, but now it does, and it's great fun (particularly since I set up SIMH and have an ancient period-appropriate version of Unix V emulated).

Brings me back to when Greybeards reigned the Earth (or rather the machine room).