There's supposed to be a little menu you can bring up on any card where you can tweak the settings. You didn't get one?
(Note: I'm not trying to blame the user here -- if the menu isn't discoverable, that's Google's problem to fix.)
(Note: I'm not trying to blame the user here -- if the menu isn't discoverable, that's Google's problem to fix.)