the whole point of an llm is to generate "plausible sounding" tokens one after each other.
It can sadly not hold any concept of truth or reality as we humans understand it
It can sadly not hold any concept of truth or reality as we humans understand it