I was thinking about this line a lot. Because yes, "not all bots" and "not in all cases".

But what gives them the right to do whatever with the sites if they claim it's for security purposes? They are not law enforcement. Moreover, other bots are missing from the docs which they clearly state on the same page. How many other bots of theirs are ignoring robots.txt?

I think we should hold Google to a higher standard than some random blogger (me).