It is actually pretty easy. As long as you don't use any private APIs, you can completely change the behavior of your app after the review by changing server side settings.
Other folks are also noting that, because humans are sometimes bad at evaluating each others' intent, it is probably a good idea to attempt to make one's intent clear if going this route, lest you annoy the gatekeeper.