Not 'on the fly' but very close. Add them, then click the recompile button and it will rewrite the configs and restart the deamon in a matter of seconds.