I think we will see models becoming small reasoning core which don't remember tonnes of facts but can reason with data fed to it or they can search.