152 karma · joined February 20, 2021
1) The rate of change not being constant is not significant as long as its variation is normally distributed about some mean. I expect that changes in environment are randomly distributed.
2) This is too small scale to have any impact on the trajectory of the numerical growth in number of base pairs.
We don't need to guess, life isn't special. The growth of complexity under favorable conditions is observable and occurs all over the place at the same rate, at scale.
You could call this technique "complexity dating". First you show there is exponential growth (or decay) occuring naturally. The actual changes occur randomly but the mean rate is fixed. Then you plot on log scale and voila you have complexity dated life itself. The only argument you can make against is that the laws of physics are somehow not constant, but I think everything froze out by the time molecules were forming.
So in your cartoon, the bride can marry a random normally distributed number of husbands each time. We would determine the average rate of husband accretion. Then given the number of husbands at any time we could determine when the rapacious bride began marrying.
I'm pretty sure the issue you raise is averaged away quite neatly by the math.
There is another way of looking at this. A problem seems "well-defined" when it is presented in terms of your current paradigm. This means that it uses the thought apparatus with which you and everyone around you is familiar. So what appears to be a property of the problem is actually a state of affairs, a property of the whole problem/problem-solver/paradigm system. On the other side of the coin, an ill-posed or "poorly-defined" problem may actually be well-defined in an alternate paradigm. In the alternate paradigm one has new thought apparatus that suddenly make the ill-posed problem tractable.
On this view, what you call "stupid" may be identical to what you don't yet understand and what you call intelligent is that with which you are most familiar. So intelligence is not a property a human can possess but a network effect that is quite intellectually bereft.
Wisdom then is the experience of watching many paradigm shifts over time and realizing that what is stupid today may be smart tomorrow and vice versa.
A continuous manifold will have a line element that allows you to compute distances between its points using its parameters. The simplest line element was first written down by Pythagorus I think, it allows you to compute the distance between two points in a flat manifold. In physics we do away with gravitational forces by realizing that masses move along geodesics (shortest paths) of a manifold, hence the saying,"matter tells spacetime how to curve and spacetime tells matter how to move". We stich together large curvy manifolds like a patch quilt from the locally Euclidean tangent spaces that we erect at any point.
Here we discard Copenhagen and move forward.
No, here we are discussing the formalism without approximations associated with an instance of its approximate application.
And QM says "The map is the terrain".
Now, that being said, the remarkable part is that the forgoing conclusion does us zero harm. We can still have the logical predictive fiction that an objective reality exists. What staggers the mind is the corollary that no human has ever erected a truth. Moreover, every intelligent species that ever endeavors to ask these questions will find the same non-answer.
If we take a formal systems approach, then an LLM is a model of a complex hierarchy of production rules corresponding to the various formal and informal grammatical, logical, and stylistic rules and habits employed by humans to form language that expresses their intelligence. It should not be surprising that simply executing the production rules, or a model thereof, will give rise to sentences that cannot be assigned a meaning. It should also give rise to sentences that we cannot prove or make sense of immediately but we would not want to discard these due to uncertainty. Why? because every once in a while the sentence that would be culled is actually the stroke of brilliance we are looking for, uncertainty be damned. The citation here would be literally nearly every discovery ever made.
When I recall information and use it, when I "think", I don't just produce sentences by the rules, formal and informal, I don't consider at all how often I have seen one word precede another in past, rather as I meandre the landscape of a given context, a thought manifold if you will, I am constantly evaluating whether this is in contradiction with that, if this can be inferred from that via induction or deduction, does this preclude that, etc.. That is the part that is missing from an LLM; The uncanny ability of the human mind to reproduce the entire manifold of concepts as they relate to one another in a mesh from any small piece of the terrain that it might recall, and to verify anew that they all hang together unsupported by one's own biases.
The problem is that just as the scarcity of factual information in the corpus makes it difficult to produce, so is actual reasoning rarefied among human language samples. Most of what appears as reasoning is language games and will to power. The act of reasoning in an unbiased way is so foreign to humans, so painful and arduous, so much like bending over backwards or swimming upstream against a strong current of will to power, that almost nobody does it for long.