Smith wrote about the political economy. He absolutely considered the balance between public and market interests. Most people talking about The Wealth of Nations have never read it.
Are there any cases where truth matters to you? I hope that this is just a rare exception, but I struggle to see how it's a principled one in any way.
Anyhow, I guess I can't stop you. "Do what thou wilt", indeed.
The invisible hand in markets is a natural property with an effect that's dependent on the environment the market operates within. He may be the first person to describe the process in writing (that we know of), but human beings have been experiencing the effects of this since we first attempted to trade with one another.
AFAICT this is (like a lot of the modern mythology of capitalism) started as a response (in the sense of an attempt to build a similar-but-opposed structure, not a response in conversation like a rebuttal) 19th Century anti-capitalist critics (and, in particular, Marx), part of which was setting Smith up as the preceding and opposing figure; a kind of capitalist Christ so that Marx could be the anti-Christ.
The "invisible hand" was something of a minor metaphor that other people glommed on to later, and its clear that they, and not his actual work, are where your idea of Smith comes from if you can say "He didn't consider its shadow/consequences" with a straight face.
An Inquiry into the Nature and Causes of the Wealth of Nations is almost entirely about the consequences of the (then-still-somewhat-emergent) capitalist economy system and its interactions with the political space. A very large part of it was warning about its dangers, and advising of how to manage and mitigate them.
This is just completely false. Wealth of Nations spends a HUGE portion of the text to talk about the negative consequences of the 'invisible hand'. Why would you say he never considered its consequences? What about his famous quote from Wealth of Nations:
> People of the same trade seldom meet together, even for merriment and diversion, but the conversation ends in a conspiracy against the public, or in some contrivance to raise prices.