Mobile design was something created for old phones that didn't have quite the resolution of computer monitors. Modern phones don't really need mobile designed sites.
Once you decide to scale text to device size so that it's readable, you are stuck doing the rest of mobile web design (fluid layout).
The problem will fix itself.
Unfortunately, it tends to take more thought because we usually want widescreen components, like sidebars, that are easier to build when you can hard-code a device width, and hard-coding width is what breaks zooming and text size changes.