This quote is harsh enough that I feel the need to say that this is one of Heinlein's characters talking.

Although the whole "innumerates are terrible" thing appears all over his books.