But that is rarely true for any privatized infrastructure alternative. There is often direct financial relations through taxation anyways, either tax breaks for the company or outright having the municipality foot the bill(see most stadiums)
Then there is the potential resource usage itself - e.g how much of the land in that city is now dedicate to toll roads that could be free, or in the internet infra case it's often exclusive rights to the poles all of the lines are ran on.