You don't need to "metabolize useful energy out of concrete, sand, glass, and dirt" to have a nightmare scenario...
Anything that can metabolize lots of kinds of multicellular living matter could can do insane amounts of damage even if it's not a pathogen... for example agriculture is quite frail and we depend on it!