Feature request for HN, Adblocker, etc: please block pages with the text “it isn’t X, it is Y”.
Should we also block pages that contain no spelling errors or no grammatical errors?
It's unclear to me if you think the resource has no value or if it bother you that I wrote it using a coding agent.
I wrote the syllabus and worked through each section. Where my understanding was weak I explored the space, pulled in research, referred the model to other sources, and just generally tried to ground the topic in something I understood.
What resulted was something that helped a lot of subjects click together for me. Especially when to reach for a particular activation function and the section on gating.
This enter survey was motivated by an ML expirent I ran with assosicative memories that just failed horribly. So rather than post mortem that I set about understanding why it failed.
Anyhow, thank you for the feedback. I submitted this in good faith that it may help others.
I know how to do it and it's all internalized. Even if I've never needed to do it.
that's the toolbox I'm trying to develop in ML. For example. I've studies LSTM and implemented one. What I didn't know was if gating was turing complete and essentially unbound. I didn't know if gates could be arbitrarily complex. Importantly I had no idea how to translate "I need a switch here" to a gate, or if a switch was even possible given the need to be differentiable for backprop.