I'm curious if someone working in DL can speak on what the major things the field is working on for the ~10-15 years? Like I'm curious if another architecture like transformers could be made (in how foundational it was to llms and most ml made today), or what problems should be solved, or may arise, in the future (given a push for ai in science/math I imagine something like verification as an integrated part or logical reasoning).
Yann Lecun is "famous" for (besides being one of the fathers of "modern" AI) his opinion that transformers are inadequate and other directions should be explored.
Bau is awesome. He is often the adult in the room who asks "but why", and cares deeply about human understanding. I am very bullish on Northeastern.
Agree. I'm not into interpretability but I always try to follow what Bau and his team are up to.