This situation seems ideal, but how would you get people to do the grunt work? This is one thing the current system takes care of with threats, for lack of better words.
What if it was rotated among "everyone"? I think people would be happy to do grunt work for a week (probably even a month or two) if it meant that they get all the rest of their time back to do what they want.