Bouncing off your point - I was at the Great Wall and someone told us that after the need for the wall disappeared, villagers were looting bricks from the wall to build the things they needed until the government stepped in to stop it
Why go chisel out new rocks to build your mill when there's an unused pile of them _right there_?