Yeah, except that someday the site that provide that useful app may be gone once and for all, while the app would remain just fine until you uninstall it. So it's a double-edged sword.
...and the domain taken over by a scammer who puts up a fake app that does unspeakable things to your USB device.
Taken out of context (and meaning), this sounds kinda naughty! :D