Instead of downloading the video, another option is to get a low quality audio only track.

The open source ytdlp tool has some parameters to list all audio tracks and their quality, and you can make a choice from there.