Google lets users log into other sites with their Google Account, there's an API for that. So just use the service that's already available; then the users don't have to trust you.

ClickPass bottles this all up into one convenient service, so why not use that?