I feel like people will never understand because it's too easy to think that it should just work.

Answer: the more you know yourself, the less you rely on the model.

Do your own reasoning or you won't be able to afford to use these things soon.