Why would I need to worry about keeping my towels "dryer"? Are you showering twice a day or something?
There's no downside to getting towels less wet (in particular when you're just flicking off water/pushing it off with your hand/arm for free), but there are upsides. So why not?