Well, let me point out that there already is an add-on called SimpleWorker which provides external worker hosting.

Basically what it comes down it is that you host your workers there, and not on Heroku. Same thing. Why you ask? I have no clue! :)