“He conclude the book by saying that when you don't know what you're talking about, it would be better for you to not speak about it”

That’s NOT what he wrote. The quote is:

“whereof we cannot speak, thereof we must remain silent.” (or “What we cannot speak about we must pass over in silence.” in this translation)

Proposition 7 is about the limits of language, not about dissing idiots.