If the new foundation models are on device, does that mean they’re limited to information they were trained on up to that point?

Or do have the ability to reach out to the internet for up to the moment information?