Hacker News Reader

in practice, learning_rate * grad(L) is mostly about the direction anyway.

But the direction is not at all binary, it's a direction in a very high-dimensional weight space.

But the vectors discussed can represent 2^3072 directions. It's close enough.