I too am repelled by the complexity of deep learning research, but using the phrase "visionary journey" in the abstract is a bit of a crank alert...
> By avoiding high depth, shortcuts, and intricate operations like self-attention, VanillaNet is refreshingly concise yet remarkably powerful.