3,367 karma · joined March 4, 2022
That won't happen. People can't phrase their objections in a succinct-enough way. When they do, the objection is superficial ("too many em dashes") and doesn't strike at the core of what makes LLM output bad.
There's a big gulf between "it's as if a human being had transcribed it and reconstructed the original document" and "so completely broken it can't be used for anything".
I don't think so. You can inflate raw data arbitrarily. They could have laid out on a page the decimal byte values of a one minute video clip of you waiting in line or something. Something redacted by a human would be much more dense in terms of relevant information, and much more digested. If it's just a data dump then at least it's information that not necessarily anyone knows, in the sense of residing in someone's brain.
Information collection is also not necessarily malicious. You can never know what you might need in the future. I was kind of on board with Recall, if the data could live in storage in my control and can I could turn it on and off at will.
Like I said in a different comment below, these are not obstacles for TCO. The compiler can simply emit a second copy of the function that doesn't need to honor a calling convention.
>So it’s a problem when implementing the compiler and adjacent tooling
Yeah, implementing a compiler is difficult work. Who ever said otherwise? I originally responded to a comment talking about TCO being incompatible with certain calling conventions. I.e. if your platform uses a certain calling convention then TCO is impossible. That's what it means for two things to be incompatible: you can have either one or the other, but not both at the same time.
That wasn't what I asked. I was very deliberate, I asked if it would be more likely to be true. What's under discussion is not your standard of evidence, but whether non-contradiction by itself is sufficient to conclude that a claim is true.
>Alas, a quick look at the periodic table raises a red flag
That's not self-consistency anymore, that's cross-corroboration. Which, yeah, good on you if you do that, but it's not the process being proposed either by the OP or by fy20.
>Physicists aren't routinely replicating every core result empirically for themselves.
OK, but that wasn't what I said. A physicist can't test every result, sure, but he can test those that are most relevant to his work. I'm not going to get into the philosophy of empiricism because it's not relevant here. My point was that an expert reading a peer's paper is not the least bit comparable to a layman reading an LLM's summary of a field of study. They're just not similar situations. One has the context and the capability to detect bullshit, while the other does not.
You can still do that with a caller-cleanup convention. Suppose you have a convention like
* Set up stack
* Call
* Clean up stack
and you have functions f(), g(), and h(), where g() and h() use this convention and f() calls into g(), and g() into h(). The sequence of instructions from f() to h() without TCO would be
* f: Set up stack for g()
* f: Call g()
* g: Do work
* g: Set up stack for h()
* g: Call h()
* h: Do work
* h: Return
* g: Clean up stack
* g: Return
* f: Clean up stack
And with TCO:
* f: Set up stack for g()
* f: Call g()
* g: Do work
* g: Move things around on the stack so that h()'s arguments are written where g()'s were. This may require a temporary stack allocation that's released before the next step.
* g: Jump to h()
(At this point it looks as if f() called h() directly.)
* h: Do work
* h: Return
* f: Clean up stack
This is always possible as long as h()'s caller-managed stack allocation is no bigger than g()'s.
gochisou: "feast"
sama: honorific
deshita: past conjugation of "desu", meaning "is"; thus, "was"
In other words, "[that] was a feast".