Is it valid for a game author to claim a copyright on something like the game's music in a playthrough though? Or is that fair use?
It is probably valid for a game publisher to claim copyright on the game's music--assuming they created it for the game [as opposed to licensing it].
I also believe that a playthrough video probably counts as fair use in most cases.
Nintendo is known for having a 'bad' reputation with playthrough videos on YouTube.