Tangentially related: I like to leave my phone at home when I go exercise, and just listen to books via my watch (21st century problems...)
But to this date I cannot use Apple's Books app on the watch to listen to audiobooks I have on mp3/mp4a/... It only works with audiobooks you have purchased in their walled garden.