I've always wondered what signal they were acting on. Perhaps the value of the MBA has been watered down, or it was just too easy to game the admissions.
515 karma · joined February 20, 2022
I've always wondered what signal they were acting on. Perhaps the value of the MBA has been watered down, or it was just too easy to game the admissions.
I can't agree more. My sister died at the hardest point of my PhD and I buried myself in my work for nearly every waking second for years, confident that at least I was doing it for myself. I couldn't have done that if I were working a normal job.
Not all PhD graduates get there; many just skate by because no one wants to fail them. They are an essential part of the modern labor force, though.
Put differently, the observed tokens are a bottleneck on the information that can be communicated across tokens. Any scheming performed by an LLM which requires more than one token to formulate must therefore pass through the visible tokens. With opaque vectors transferred across decoding steps, this is not the case.
The computation in the hidden layers, as far as we can tell, is not sufficient for scheming in a single decoding step. It looks like it requires O(10^2) or O(10^3) steps instead, judging from anecdotal evidence like the reports of scheming from o1 (https://cdn.openai.com/o1-system-card-20241205.pdf)
As far as your last point goes, I'd rather have a more transparent system, all other factors held constant.
We should make reasoning fully visible in the output space.
Loans to Musk were a risky asset before the election. He was at risk of investigation in the event Trump lost. No one would have given him a loan big enough to supply the cash needs which this sale supplied.
That said, ordinary billionaires can of course make use of this strategy.
This is a risky step backwards, and for apparently little gain.
This scheme only makes sense if the amount of biomass added every year is much larger than the amount which is present in this external layer.
Anecdotally, my father has told me about soaked hay bales out in the pasture which still had a frozen interior core by late May.
I thought about this for awhile and the gap between harvest time for many crops and first frost isn’t enough to get more than a few inches of rainfall in most agricultural regions with favorable economics.
I think the wetness will wreck the insulation of the first meter or so, but won’t lead to much convective heat transfer if the outside never gets saturated. A big if, to be sure.
As an aside, it’s common practice to leave large piles of grain outside overwinter in the central USA and it’s not optimal, but they certainly don’t saturate the whole way through with water.
Is it still not rendering? It looks fine in my browser.
My hope would be that the thawed region would be a very thin shell overall, so the overall emissions as a fraction of total stored mass would be relatively low. Can you think of any ways to minimize anoxic activity in the thermally active area?
Do you have any stories or anecdotes to share?