This is the same conclusion I've come to, in basically the same way. It's great to see that I'm not alone in thinking along these lines.

There ought to be a physicist that has walked down this path already. I'd be very interested in reading about their findings.