Comment by ynniv | Hacker News Reader

Top New Best Ask Show Jobs

Comment by ynniv | Hacker News Reader

Parent Full thread

How long can a page of python take? https://github.com/Zyphra/tree_attention/blob/main/tree_shar...

You seem to know your stuff.

Will this technique work with existing model weights?

Yes, it is just a way of computing the self-attention in a distributed way

Reply on news.ycombinator.com