Anyways. I thought the documentary was inspiring. Deepmind are the only lab that has historically prioritized science over consumer-facing product (that's changing now, however). I think their work with AlphaFold is commendable.
3,928 karma · joined December 23, 2009
http://x.com/f
Anyways. I thought the documentary was inspiring. Deepmind are the only lab that has historically prioritized science over consumer-facing product (that's changing now, however). I think their work with AlphaFold is commendable.
Like GP said, I think the trick to this book is in the relationship between the 2 main characters, so hopefully they nail that. Judging by the trailer they made it all quite humorous.
On what grounds?
I could replicate it immediately at will. ANC on, nothing playing, sat on the driver seat and closed my door with a little bit of force.
Well who does the inference at the scale we're talking about here? That's (a key part of) the moat.
Labs can just step up the way they track signs of prompts meant for model distillation. Distillation requires a fairly large number of prompt/response tuples, and I am quite certain that all of the main labs have the capability to detect and impede that type of use if they put their backs into it.
Distillation doesn't make the compute moat irrelevant. You can get good results from distillation, but (intuitively, maybe I'm wrong here because I haven't done evals on this myself) you can't beat the upstream model in performance. That means that most (albeit obviously not all) customers will simply gravitate toward the better performing model if the cost/token ratio is aligned for them.
Are there always going to be smaller labs? Sure, yes. Is the compute mote real, and does it matter? Absolutely.
I'd take that bet. At scale, (and those 3 are the definition of scale) you can mitigate some of the downsides of Ruby (i.e. speed), but you can't recreate the upsides (i.e. developer satisfaction, learning curve, flexibility) elsewhere.
> Go and Typescript seem to have taken its place, which makes sense because they're both much better languages.
Again: depends on the metrics you're considering. I would certainly consider Go much better than ruby on some metrics, but most definitely not all - and importantly, if I put all of it on a scale (and this is where bias comes in), I still give the edge to Ruby over both of those.
Obviously, clearly untrue. You go ahead and try stopping a behavior that reinforces your beliefs, especially when you're in an altered mental state.