Hacker News Reader

Comment by pottspotts | Hacker News Reader

This is really great, thank you. I would love to see a real "from scratch" that doesn't use torch.py et. al., though.

The entire series is at https://karpathy.ai/zero-to-hero.html, first video is literally from scratch (i.e. just Python, the only external dependency is for plotting graphs if I recall correctly).

Andrej's "Building Makemore" series is exactly this, it includes a wonderful lecture where he computes all the gradients for a simple network by hand and compares them against the values produced by torch's autograd.

I find Makemore to be my favorite neural-net-based (w)rapper.

Same, but one that doesn't assume python or an operating system.

Same, but I would honestly rather we get away from silicon or anything resembling what we call these "computers" these days. Things are too complicated and we need to truly get back to the basics: rocks on a hill.

Abacus-driven deep learning with trained monkeys flipping gradients.

Outside tools are not required.

We'll selectively breed humans until one can just compute it in...meat[0].

https://www.youtube.com/watch?v=7tScAyNaRdQ

in mitro computing

You don't need to flip gradients, just need to train the monkeys to operate matchboxes: https://en.wikipedia.org/wiki/Matchbox_Educable_Noughts_and_...

Reminds of that part in the Three-Body Problem novel where the emperor of the videogame builds a CPU with soldiers as bits

Sounds like a project for Ben Eater https://eater.net/

That would be next to impossible to do even in a semester long course...

Here you go: https://www.youtube.com/watch?v=VMj-3S1tku0

Does one really need Python. What about using Lua.

https://news.ycombinator.com/item?id=7928738

Reply on news.ycombinator.com