If your users expect a reasonable level of UX quality, you're likely better off giving a middleman his ounce of flesh.
If not, then spend your valuable time hacking together some combo of scripts and open source code to watch your wallets for incoming payments.