Switzerland has a weak federal government. The cantons are smaller than US states, but have more autonomy, and a lot of matters are decided by direct democracy. Yet they still seem to have good public infrastructure.
But it's true that public infrastructure is more dependent on local rather than federal governments. I think the best example of weak local governments has to be the UK [1].