Thanks for that extensive explanation. I'm not working there anymore.
First we had no test and everything was crap.
Then we did scripted tests and things got pretty good.
Then things got worse, because of the regressions, when one person did the tests for too long.
In the end we settled for students for a semester each, because they were really cheap and didn't want to do that job for long anyway.