I just set it up to run tests on an app I'm developing after each check in. It was amazingly easy to get running, and so far it's worked wonderfully.
Amazingly for a Java app, I didn't have to touch a single XML file. Everything can be configured through the web interface. Fantastic!