We've found this to be the great spot in between.
https://github.com/rdy/fixture_builder
You use factories to build your fixtures and it regenerates if needed.
I used it in a sample app recently here: https://github.com/taskrabbit/rails_engines_example/blob/mas...