At least for modems near the end of the period. The very first ones at 300bps really did sound like cassette audio.
Random example: https://www.youtube.com/watch?v=wVsY9PVIKsQ
Also reminds me of Amiga's Video Backup System which made use of Amiga's video processing capabilities to output data and read from VHS tapes. That was a slow process but could store large amounts of data, and you just needed a VCR.
I’d note that as then-large amounts of data.
“520MB will fit on a 4-hour tape!”
Danmere Backer was similar for PCs, with custom hardware; they got up to 4 GB a tape.
Dial-up modems used the public switched telephone network to transmit data via audio signals through regular phone calls. The modems had an internal speaker so the operator could “debug” the connection with their ears, e.g. if they called the wrong number and an actual person was talking on the other end.