You may want to consider supporting .gems files for specifying additional gem dependencies since that's what Heroku uses. Their customers would potentially be interested in your product also and I couldn't imagine they'd want to maintain two dependencies files.
Is there a way to specify how the tests are split across test machines or the order in which tests are run?