I am currently using Resque(http://github.com/defunkt/resque) for a similar requirement. You might want to check it out.
edit: This is in Ruby though.
edit: This is in Ruby though.
We use DJ for jobs that MUST succeed (e.g. autopost) whereas we use Resque for more frequent but less essential jobs.
If you need support for "job prerequisites", (one job to not start before other jobs have finished successfully), we'll be adding that to our fork from collectiveidea soon. The DJ codebase is pretty nice to look at, too. Note also that there are capistrano dj deployment recipes in the git source.
I've now got multiple choices that seem like they can do the job and just need to decide which one is the best fit.
Thanks