How about withholding the name still, but offering a way to 'opt-out' from voting. You don't see the name until you either vote up or opt out. After you've withheld your voice, you can't go vote again on that submission/comment.
How about voting down?