What I find interesting is current LLM’s are based primarily on written data which is already an abstraction / abbreviation of most observed phenomenon.

What happens when AI starts to send out it own drones or perhaps robots and tries to gather and train based on data it observes itself.

I think we may be closer to this point than we realize… results of AI could get quite interesting once a human level abstraction of knowledge is perhaps reduced.