I don't think the argument is that people can't understand '&&' and '||', but that using 'and' and 'or' is a better choice.
Python expresses the bitwise and and or using the & and | characters, the exact same characters as Go.
And that also explains why Go chooses to use && and || for and the logical and or operators.