If you don't have a google-enabled android device (as I don't), and you've registered your Yubikey with google (as I have), they won't use the Yubikey they will SMS you instead.
Seems like they prefer google prompt, then SMS, then the actually secure stuff.