With all due respect to Graeber, and acknowledgement of Smith's faults, far
more of the apparent contradictions in Smith come from those who grossly misrepresent him, whilst at the same time strongly discouraging others from reading him directly.
I'd compiled a set of quotes from Karl Marx and Adam Smith a ways back and encouraged people to tell which came from whom:
<https://news.ycombinator.com/item?id=26127620>
The "butcher, brewer, and baker" quote is most often seen in a form that ties it together with another passage hundreds of pages from it within Wealth. That construction was created in the early 20th century, more than 100 years after Smith wrote his work, by Jacob Viner, at the monopolist-defending University of Chicago. My understanding is that this was initially an exercise to show how much one could twist Smith's meaning by selectively editing his work. It's since come to be taken as a flat statement by Smith, as originally intended, when it is in fact no such thing.
In fact, the chapter in which the vastly over-exaggerated and greatly misconstrued phrase "invisible hand" occurs, begins with a discussion of restraint of trade by monopoly interests, including of the previously-mentioned butchers:
BY RESTRAINING, either by high duties, or by absolute prohibitions, the importation of such goods from foreign countries as can be produced at home, the monopoly of the home market is more or less secured to the domestic industry employed in producing them. Thus the prohibition of importing either live cattle or salt provisions from foreign countries secures to the graziers of Great Britain the monopoly of the home market for butcher's meat. The high duties upon the importation of corn, which in times of moderate plenty amount to a prohibition, give a like advantage to the growers of that commodity. The prohibition of the importation of foreign woollens is equally favorable to the woollen manufactures. The silk manufacture, though altogether employed upon foreign materials, has lately obtained the same advantage. The linen manufacture has not yet obtained it, but is making great strides toward it. Many other sorts of manufactures have, in the same manner, obtained in Great Britain, either altogether, or very nearly a monopoly against their countrymen. The variety of goods of which the importation into Great Britain is prohibited, either absolutely, or under certain circumstances, greatly exceeds what can easily be suspected by those who are not well acquainted with the laws of the customs.
<https://en.wikisource.org/wiki/The_Wealth_of_Nations/Book_IV...>
The late Gavin Kennedy's blog, "Adam Smith's Lost Legacy" covers this misrepresentation in depth:
<https://adamsmithslostlegacy.blogspot.com/>
(I'd need to hunt through that to find specific posts of note, though I'd encourage anyone reding this to go through it on your own.)
There's a book of the same title:
<https://link.springer.com/book/10.1057/9780230511194>
Kennedy's hardly the only person to point this out. John Kenneth Galbraith made much of how Smith was misrepresented during his lifetime, and Steve Keen is amongst present-day economists doing similarly, if memory serves.