That's what's interesting to me. Even after a fire, wouldn't someone want to go scrape through the remains to find stuff like that?

To me that seems like that might lean towards a deliberate fire / untimely fate for the inhabitants from an enemy, who might not know where that axe would have been stored.