Yup, I live in another city that has a setup like this (Conway, AR of all places). Ours even goes a little further than EPB though.
Electricity, Water, Sewer, Trash, Cable, Phone, Internet (already fiber for recent builds, upgrading all to it currently) all through one company that's owned by the city...it's amazing.
One bill a month, and my bill is ~300/mo for all services including 1Gb/s fiber. Plus the other aspects of it. Tech support is someone sitting downtown, power outages are fixed in record time... just so much is right with the model.