A question: is any of the currently hot software written also in Lisp? I mean the LLMs, SD, etc.
A question: is any of the currently hot software written also in Lisp? I mean the LLMs, SD, etc.
I would say so, specially when you plan to use it for web dev (welcome!). Shinmera has released a game in CL heavily depending on CLOS (object system), and he says the GC is barely a matter.
https://raw.githubusercontent.com/Shinmera/talks/master/els2...
Now, your time to build cool things and share in the process ;)
---
Going longer between garbage collection cycles could be worse in terms of caching and paging. Marking the live objects allocated in that generation is about the same, since that doesn't grow, but there is more garbage to visit and sweep. Sweeping a smaller memory area more frequently is going to be faster than sweeping a larger area less frequently, from the point or view of caches and TLB.
(Regarding my remark about live objects; with larger collection cycles, they could be spread in a wider VM footprint, even if their quantity doesn't grow. The image has a kind of "GC working set"; longer intervals mean that there is a longer working set. The data being transformed cycles through more memory locations.)
I don't think anyone's written a transformer or diffusion model with it, could be a fun challenge.