1,086 karma · joined April 2, 2009
The company should consider targeting RP instead of General American. In my experience attempting the latter with a slight Asian tinge makes you sound like you're trying to be a WASP, while speaking the former with the same small errors makes you sound like you studied PPE at Oxford.
https://www.statnews.com/2023/06/21/cryogenic-organ-preserva...
It has also been pointed out that launching enough space-shades with chemical rockets would itself deposit a considerable amount of particulate matter in the upper atmosphere, so to be really atmospherically 'clean', one would need to complement geoengineering with a radical new launch technology.
"it regarded intelligence simply and solely as a weapon… Thought was for it a device necessary to certain ends, but thought in itself did not interest it. It assumed reason… externally and inorganically…"
I tried to find people complaining about being left on hold by shopify support and got nothing on twitter. All the complaints are about the account payments being on hold, i.e. shitty but par for the course risk/compliance issues.
The remaining thread content is the sort of inference and speculation that anyone with the right political bent could have made, given a few hours to research the company.
> It would be interesting to know why you chose those FLOPS targets, unfortunately it looks like the models are quite under pre-trained (260B tokens for 13B model)
> We chose to train these models to 20 tokens per param to fit a scaling law to the Pile data set. These models are optimal for a fixed compute budget, not necessarily "best for use". If you had a fixed parameter budget (e.g., because you wanted to fit models on certain hardware) you would train on more tokens. We do that for our customers that seek that performance and want to get LLaMA-like quality with a commercial license
Which is the point made elsewhere in these comments, e.g. https://news.ycombinator.com/item?id=35344192, and also usefully shows how open Cerebras are. They're pretty open, but not as much as they would be if they were optimising for filling in other companies' moats.