There are quite a few applications that do something similar, they leave a "disabled=1" or similar in the config to make sure people look at the config before trying to run the software. I remember the eggdrop IRC bot doing it (http://cvs.eggheads.org/viewvc/eggdrop1.6/eggdrop.conf?view=... , look for the lines starting with die) this and I'm sure there are more.