I've used pickfu a few times - usually get results in 24 hours. I'm bad with colors so it's nice to be able to ask 50 people for $5 which look they like better of a site. It's great because I want real feedback - great when people really tell you if they hate something instead of getting the real world "Oh, nice" responses.
Also used it to ask about domain names.
Edit: I like the site - good layout & like the KISS approach. Good luck.
Thanks I hadn't seen that I'll definitely check them out. Do you know if they use MTurk or some other service?
Feedback Army uses Mechanical Turk. Indeed, they say on their pages that the questions a user submits must comply with MechTurk guidelines.
Question for anyone: would you bother checking every question manually to make sure not to cause any trouble with Amazon? Or would you automate it, hope that the users comply and if they don't, deal with the problem then?
Or you could simply post the questions the user entered as a HIT and ask turkers "Does this text comply with mechanical turk?".