2,119 karma · joined September 1, 2018
More & contact: https://omarkama.li/about
I'm always happy to chat so hit me up!
I'm running Q4 and it's taking 17.94 GB VRAM with 4k context window, 20GB with 32k tokens.
What was even more impressive is the 0.6B model which made the sub 1B actually useful for non-trivial tasks.
Overall very impressed. I am evaluating how it can integrate with my current setup and will probably report somewhere about that.
In Arabic[1], there are two close phonemes: `/dʒ/` for `ج` and `/ʃ/` for `ش`
The difference in both phonemes is minimal and are practically affricates[2] of each other (where `d` or `t` can precede a `ʒ` or a `ʃ`), so it seems these sounds are present in both Arabic and Persian.
These variations are also within the dialectal distribution of either languages. For example `ج` is pronounced `/dʒ/` in Algeria and `/ʒ/` in Morocco.
0: https://en.wikipedia.org/wiki/Help:IPA/Persian
I’m also quite curious about the sounds of “ch” and “zh” which exist in Arabic as ش and ج, or did you mean something else?
AI suggestions can also be as simple as autocomplete and still be counted for the sake of engagement metrics.
Oh and in enterprise settings and especially MS shops Github Copilot is being pushed everywhere, (forceful) adoption rates are much higher than the market average.
Encrappification at play.
The problem therefore is not how to scale PR review and rather how to select meaningful work to perform, which brings me to the second point made by TFA: humans making judgment calls on whhich PR should be prioritized being a uniquely defining human feature.
I beg to differ here as well. All the problems described in the article are high context decisions, you need to take a lot in consideration (user request, product strategy, market dynamics, cost/benefit, rou..) to decide which feature should be prioritized in the next release. What prevents LLMs from being able to help with that is the sheer amount of information to ingest which is a still a limitation despite the long context windows we see nowadays.
tl;dr: this is a problem of prioritization and product strategy and nothing specific to AI. Scaling so-called judgment is a red herring and better focus and scope management should be aimed for instead.
In my early tests however, several of the advertised languages are not really well supported and the model is outputting something that only barely resembles them.
Probably a dataset quality issue for low-resource languages that they cannot personally check for, despite the “119 languages and dialects” claim.
This is why Starlink keeps launching new satellites on the regular. I believe theirs have a six years lifespan but don’t quote me on that.
https://mermaid.js.org/syntax/entityRelationshipDiagram.html
Just checked your work on covary and it's pretty rad! What's your backend like?
The most important question here, and yet the article keeps talking about "fingerprints" of anecdotal but limited insightfulness.
While it worked great to gently expand my knowledge on what's possible in programming (I would have burned myself on a lisp, not for the lack of trying as I did with Haskell), it also taught me about the meaning of shooting oneself in the foot, and in a sense do not regret the absence of such powers in JS and Python, even if Proxy objects are dangerously close!
Of course you could do like deno and other such systems and just deny internet or filesystem access outright, but then you limit the usefulness of the AI system significantly. Tricky problem to be honest.
This is like an OS developer who has never heard of Linux.
I already got quite a lot of the data pipeline setup for this, so if anyone wants to collab hit me up!
Have you considered other options? Curious if you came across anything particularly interesting from the simplicity or DX angle.
Svelte on the other hand felt like a breeze. Most of my app is actually plain simple HTML, and I am able to sprinkle as little JS as I need to achieve my desired behaviors. Sure, Svelte <=4 has undefined behaviors, or maybe even too many magic capabilities. But that was part of the package, and it was an option for those of us who preferred this end of the trade-off.
Svelte 5 intends to give that precise level of control and is trying to compete with React on its turf (the other end of that spectrum), introducing a lot of non-standard syntax along the way.
It's neither rigorous Javascript like React where you can benefit from all the standard tooling developed over the years, including stuff that wasn't designed for React in particular, nor a lightweight frontend framework, which was the initial niche that Svelte happily occupied, which I find sadly quite empty now (htmx and alpinejs are elegant conceptually but too limiting in practice _for my taste_).
For me it's a strange "worst of both worlds" kind of situation that is simply not worth it. Quite heartbreaking to be honest.
I don't know if that's what the GP hinted at, but as a Svelte developer and big advocate for more than 6 years (single handedly training and evangelizing 20+ developers on it), I found so many concerns with Svelte 5 that it simply made me use React again.
It's a temporary choice and I'm desperately evaluating other ecosystems (Looking at you SolidJS).
We build logic once and make it automatically accessible from any of these consumption methods, in a standardized way to our clients, and I am indeed piping some of these directly in the CLI to jq and others for analysis.
It’s in the 3rd line, the one before the website url (penultimate).