No, I don't think you're missing anything. I had the same question, and midway through typing it realized that it's really all about verifying that the person who signed your NFT was in fact the artist that created it.