Hacker News Reader

Where is the GPT implementation in JAX? I only found this [1] in PyTorch and NumPy.

For a prior generation of karpathy-splaining this is this Nim port: https://github.com/Vindaar/llama2nim - maybe of interest if you are interested in Mojo.

Thank you!

How in Mojo do you support GPU data parallelism and all the benefits it brings ?

You don't. Mojo doesn't support GPUs at the moment, which says a lot about a language which claims to be AI first.

They only made Mojo available outside the preview circle about a couple of months ago, and it is yet to run on Windows laptops of researchers.

I love the attitude of considering 0.x languages production ready for all imaginable kinds of workloads.

If you want CUDA up front go write PyTorch. No one is stopping you. Modular’s goal was to leverage MLIR first and bring GPUs in later. They’re barely a year old company.