Not even humans with PhD can do physics research without a lab. How could a model with just a few tokens of context window and no body do that?
Genuinely curious.
So it's possible, in theory, that an AI-in-a-box could do the hardest parts of science aside from experiments. Whether modern LLMs are any good at it is a different question.