2nd Batch of the A16Z Open Source AI Grant

Huge props to A16Z for supporting lucidrains' work! His prolific output was instrumental to my self-teaching process when learning about Transformers, as he probably has the largest collection of publicly available implementations of Transformer-related papers in PyTorch.

I think a large amount of people who get interested in implementing deep learning papers end up referencing lucidrains' work.

When my GPU is under strain, my monitor makes weird noises - and so it does on this page! And then I checked my GPU util, are they mining bitcoin or training models using my GPU? :)

Volatile GPU-Util 43%

Is it only me or this webpage hangs on mobile?

I immediately thought of the Axolotl Tanks in Dune when I saw this list. Great name.

How much is the grant, it doesn't seem to be disclosed?

Very nice to see LLaVA there, IMO it's one of the last puzzle pieces for a proper open source infrastructure in AI (e.g. filtering/classification after something like artspew).

A bit surprised about common crawl, is the financial cost there due to the massively bloated scale of the modern web they're (presumably) still trying to crawl?