Can you give me some examples of an actual creative output from a human that wasn't coached into it or random juxtaposition?
Perhaps I don’t understand relativity and its precursors well enough to see how it was incremental, but either way i’ve yet to see anything remotely like relativity, or even anything like more traditional examples of creativity like picasso or van gogh, come out of an llm
Einstein contributed an argument (relativity) in 1905 for why this should be the case, which lead him to make important inferences such as mass energy equivalence. i.e. he took existing maths (derived from experiments) and was able to extrapolate it to other cases.
General relativity 1915 is similar. Starting from general covariance (the equations should look the same in all frames, even if the numbers/coefficients change) and his equivalence principle (acceleration indistinguishable from gravity) there are only so many places in the equations where a simple formula for gravity can fit (and there were sound reasons to expect the formula is simple). Einstein (and others) developed several of the possibilities before he settled on the famous field equations.
I say all this because once you realize each of these ideas was built up incrementally by dozens of people over the course of years/decades and was deeply rooted in experimental observations, then it's harder to believe that it is beyond the capacity of AI. In fact, AI is contributing to cutting edge understanding of gravity https://bigthink.com/starts-with-a-bang/ai-first-breakthroug...
In the first case you are directing the creativity, in the second you can ask for non-random all you want but the output will be definitionally random based on the training weights and the temperature setting of the prompt.