If you're using youtube-dl, you can tell it to download only the audio track in the first place. Try `youtube-dl -F video_id` to learn what formats are available, then `youtube-dl -f format_number video_id`.