Why would LLMs not learn abstractions when given millions of of concrete examples?

1. Rule of probability: The concept of statistics is being used to predict outcomes based on previous observations or experiences, such as the likelihood of an object falling when released.

2. Rule of inherent knowledge: Some understanding or knowledge, like objects falling when not supported, can be known without explicit study or exposure to the specific terminology (e.g., gravity).

3. Rule of generalization: Observations or experiences with one type of object (e.g., a smartphone) can be generalized to other objects or situations, as long as they share similar characteristics (e.g., not being supported).

4. Rule of causality: There is an implied cause-and-effect relationship between an action (releasing the grip) and an outcome (the smartphone falling to the floor).

5. Rule of experiential learning: Knowledge can be gained through direct experiences, even if the specific terms or scientific concepts are not known.