498 karma · joined June 20, 2022
I think trying to bar such a system simply would make the same things covert.
Optimistically, it exposes clear marketable opportunities in existing suites.
"we just don't know" is a non-answer.
If Tao's point is in predicting rapid change from a game theoretic perspective, perhaps it would behoove university executives to court industry for research dollars, instead of an ouroboros of invented problems and federal tax dollars.
Even state tax dollars are more likely to have a clear purpose.
In this case the enabling technology price/existence was apparently not well-estimated. And apparently they didn't have enough foresight to use a conformal coating.
Also an initial contract of 10 years without a test market? That would be the pinnacle of incompetence.
Similar experience trying to use GenAIScript, btw, and peering inside the box the code and product is pretty well incomprehensible.
Maybe we don't need momentum right now and we can cut the engines.
Oh, you know how to develop novel systems for training and inference? Well, maybe you can find 4 people who also can do that by breathing through the H.R. drinking straw, and that's what you do now.
What are the tools of thought that will help students now succeed and advance technology in 20 years?
Perhaps there is a market fit for a laggard GPT. Something useful but exhibits clear errors that a student could pick up on, and so recognize the risk of blindly accepting information like this. The same issues are associated with excess reliance on traditional publications, "the armchair scientist" and so on.
Maybe, trained sequentially on the curriculum like a student, or something personally orthogonal so that the bot excels where the student is known to fail, create gaps where the student is known to succeed. It seems straightforward to fine-tune in this way since the corpus is smaller. For each grade level and setting A/B/C across the 4 subjects, maybe some 300 fine-tuning?
The current batch is trained on just text afaik.
Go doc had a bunch of, puzzling things going on / barely working, Rust doc is pretty much as described in the book and reference.
Although in the C ecosystem, Doxygen is pretty nice, the docs there have to be 3d to account for the way C code bases can work.
Seems to suggest it's indeed a hashmap in implementation, but I can't be bothered to look any closer.
Funny that's already so intuitive for how touch interfaces works, I guess it would take maybe a week to change but forever to decide what specifically precisely should be done, so if it's not something epoch-defining, world-changing and comparable to search itself, then maybe just leave it, lest you make a mistake that half the customers likes.
It seems all of their years of letting the open web decay and vanish has caught up with the fact that many requests can be serviced with an inverse thesaurus manual snippet soup.
This is probably already happening within the parade of censorship systems trying to imbue the models with agency
I think there's even a take that you can tease the patent system as a way to profit from failing to explain ideas effectively.
Edit: maybe the consideration then is what are the roles missing? if there's a way to improve off-the-shelf model performance faster than moore, what is it? scaling to teams that specify more specialized roles; simulation, model architecture / quantization specialist, systems-level, hardware-match specialist / minimization? some sort of way to compose, or perform operations on the content of models?
Languages evolve with expertise, specialties are tailored to and can be permanently and effectively captured; and not just captured, but reused as in the case of libraries.
Perhaps there's some core capability missing from the MATLAB ecosystem that isn't so obvious on the surface. What I know about MATLAB is it is primarily focused on simplifying and making performant DAQ / processing cycles, but not necessarily associating concepts to use-cases and correctness/effectiveness (and probably optimality, as an important thought) -- say with how Objects and Types compartmentalize data transformation effectively for user-facing software applications with understandable UIs.
To motivate some of the machinery, you know systemically it's kind of a no-brainer for how financing and oversight works I suppose; overseers want to see early results which you might get from a knowledge worker rehashing or tweaking an existing solution, and then integrators get to play 'pick up sticks'.
So you have the integrator is the "buyer" because they have opted to defer product expertise (disregarding whether there's even any real cost, i.e., a FOSS solution, etc. "buy" meaning "not build").
The buy side has popular tools like linters, static analyzers; this is pretty huge. If you look at the "cloud native" space, treating lots of the cloud software players as "integrators" of software that's intended to be distributed, public, always-on, and at a cost of 'ad-supported' the buy side has the "Security and Compliance" layer: https://landscape.cncf.io/ ... a lot of money is flowing there too, since it simplifies precisely what you mention there, so you're in good company. Granted, "integrator work" might be a bit less specialized than the sorts analyses these tools might perform, but it's the same problem applied instead of abstractly "domain expertise" to "domain expertise of deploying existing software solutions."
It might not be popular thinking, but doc tools like CodeViz, doxygen, any worthwhile IDE, and other tools in the space are probably somewhere between the next space:
OTOH managers are sort of 'friendly buyers' for the expertise of their employees, so you can look at the tools of requirements elicitation, definition, capture, scheduling, prioritizing, and lifecycle management too, thinking specifically of like stories, epics, kanban, and presumably legacy systems like DOORS, which I don't have any experience with. If you want to avoid too much philosophizing and want to defer to some pretty broad experience SWEBOK has a lot of words about this more 'pre-compiled' approach rather than 'just-in-time' approach that most agile-type firms will use for their usually simple value props.
The same sorts of things might apply though; identifying whether "coverage exists" for "domain-expert produced prototypes" -- specifying the form of those, in say what you mention, signal processing. Basically, TDD -- does the shipped code match the tests? Does the integrator know enough to write such tests?
Essentially using 3rd party machinery to establish acceptance criteria, and clear targets to ensure that the "buyer-builder" contract is fulfilled.
I think that either condition, though, is probably monetization; either an upsell to more layers, or a downsell to the O'Reilly book...
Having recently gone through this trying to get into React ecosystem, but avoiding the most common frameworks, `create-react-app` has docs that sort of seem like a tutorial but rapidly spirals into random advertisements, since it's pretty simple and not really a React tutorial; in-fact Meta apparently disavowed the whole thing, but it still seems to work OK.
It seems natural, incentives and open-source are tricky though, since if you're trying to simply compete rather than collaborate, it will be counterintuitive.
In fact (you mention Next.js) React itself almost immediately spirals off into advertisements for 'supporting technologies' like some of the popular React-focused frameworks.
Maybe you can read either condition as, "Oh; this part doesn't do that" or "Oh; maybe I need to read the source code to understand" or an invitation to collaborate, rather than as a design flaw.
Location: TX
Remote: Sure
Willing to relocate: Sure
Technologies: IP Networks / Networking, Rust, Linux / Bash / Perl, Regex, Elasticsearch, Logstash, JavaScript, Ruby, Docker, Git
Resume: https://github.com/meltyness https://blog.tomtech.link https://leetcode.com/u/meltyness
Email: tjh@duck.comStill getting into the reading here, but making my intuition a little bit more explicit, it seems that at least the design, but possibly the implementation of Homa actually hinges on datacenter switches QoS queues being configured with a policy to explicitly respect the receiver-assigned priorities... cool!
At least that's how I picture the start of the study of such a design.