I feel like this has only been Numberwang once when I've played with friends. Am I playing it wrong?