For the iOS gmail app you can choose to be notified for all new mail or "primary" only. I'm not sure about using a built-in client like the Mail app though.