414 karma · joined September 27, 2010
Cursed companies:
- https://permtrack.app/employers/microsoft-corporation
- https://permtrack.app/employers/tata-consultancy-services-li...
Blessed companies:
For what it's worth, if you haven't already, you can also let it run overnight (if you have compaction enabled) to see if it ever gets out of that hole. The reason `xhigh` is the default is because 3.8 is trying to optimize for long horizon tasks where monitoring its every single thinking misstep might not be a good use of our time.
I have heard good things about Pi which supports auto-compaction, but I can't personally vouch for it since I use my own.
It's well-known that while quantization affects the sampling probability distribution (given the same context, which next token is the most probable), Qwen 3.8 27b seems to offset that by just thinking more and as a result eventually finishing the task (benchmark or otherwise).
So as long as the thinking (albeit longer) is sound, this leads to the same success rate (as shown in the article) but potentially at the cost of more tokens and hence more time.
I think it'll be further useful to chart each quantization's used tokens as well, in addition to the success rate.
Thanks for doing and sharing the research!
I just wish this smear campaign against them stops sometime soon.
[1] https://www.visalaw.com/onboarding-mass-litigation-clients/
[2] https://twitter.com/LilySAxelrod/status/1437846756394520582
https://mobile.twitter.com/TravelGov/status/1285331446232743...
For the second but last level (which will be entered n! times) it is doing n iterations which gives us a (not so tight) lower bound of n * n! instead of the optimal n!.
The issue is the use of an array for visited instead of, say, a linked list where each level gets a list of only unvisited nodes.
Statement A: Tesla is just hyping autonomous driving since no technology can deliver fully autonomous driving right now.
Statement ~A: Low-cost LIDAR is available to any high-volume customer, of which Tesla is one, given Model 3 demand. And LIDAR can deliver fully autonomous driving.
The point simply being, I have a hard time believing that even with good-looking, cheap LIDAR being a possibility, as you claim, Tesla chose to go with an inferior sensor suite, for no apparent reason.
> ...expect to see better design.
> ...costs too much until one of the three companies claiming to be building low-cost automotive LIDARs Real Soon Now manages to deliver.
All I see is future promises. Tesla wants to do this now, that too at mass market costs, independent of whether those promises materialize or not.
It also depends on how much you trust their R&D team. If they thought this was a week sensor suite and something else was just around the corner, they won't risk fitting their cars with inferior technology which would be obsolete in a couple of years, making all the collected data worthless. Yes I am aware they did this to existing cars lacking the full autonomy hardware, but I find that OK, since, for them, they never promised full autonomy to begin with.