I’m not even sure Smith was a capitalist in the modern sense. He held out similar derision for the merchant class, although the exact quote escapes me.
People of the same trade seldom meet together, even for merriment and diversion, but the conversation ends in a conspiracy against the public, or in some contrivance to raise prices.
– The Wealth of Nations, Book I, Chapter X.