So a related question becomes, can you learn to understand and thus predict physics (the way a child does - I'm not talking about quantum mechanics) from literature only, without interacting in space?
Look at animal kingdom some animals are walking about 5 minutes of being born and running in hours.
How about when you include multimedia recordings? Or give the machine a camera and wheels?