No, you don't need to personally verify all facts. But you need to be able to observe several indepedent validations. Yes, somewhere you have to take someone's word for fact, but multiple independent observations is a close approximation to the perfect scientific method. Related to that is the fact that science is not a democracy, and these observations have to be weighed against how they fit in our generally accepted worldview. Theory is more than just facts.
Every little detail of science has to be questioned, just not by everyone personally. Where that limit for healthy skepticism is drawn is not something can answer logically, but we can recognize if it is completely wrong.
There continue to be no shortcuts to truth.
Basically you test what you have and trust the description of the implementation. If it works you can trust the whole chain. This is of course not 100%, but it is about as reliable as it can get for an individual.
What you shouldn't do is assume that stuff that aren't 100% for sure are equally bad.
As an uninformed consumer at or the bottom of the chain, you cannot trust that an interface that works today, will work tomorrow, for you do not have access to all of the chaotic variables which constrain the interface.
So while I can't prove something is right by appeal to authority, it's a very practical way for me to swift though the unbounded mass of claims and information that I couldn't possibly verify or prove in my lifetime, not even to a 19th century level of scientific knowledge.
For example, I saw an onion cell once at a school microscope, but I have never seen a bacteria. So as far as I can independently prove, I live in times before the germ theory of disease - but that doesn't mean I shouldn't trust my doctor when he recommends vaccines and antibiotics. The entire antivaxx movement is just an attempt to challenge the medical authority by people who are not intellectually equipped to verify the scientific claims.