>It would be nice if . . . there were an "unflag" button.

Uh, there is: when you click on "flag" it turns into "unflag", and when you click on that, it turn back into "flag".