The browser won't help you avoid putting it in the login form at google.com.fakehackersite.com which can then just relay that to real google.
I think this is still an improvement over SMS, and personally is something that risk wise I'm happier with than the idea that if I lose a yubikey or it breaks down it's game over.