This is changing, I (think|hope). Two years ago I was building 1MB+ sites (because: SPA). Now I am down to 500KB, due to SSR and code splitting. Performance is back on the menu.
I think some very simple (tens of loc) Go programs I wrote ended up compiling to Linux binaries of about 5mb.
This can be the case, depending on imports(looking at you, fmt). But it doesn't scale that way, I assure you. So you may hit 5 to 8mb early on in building a basic 100loc webserver. Then at 100k loc you can be looking at 10mb.
I've found most of our rather large webservers unoptimized, to be in the 10 to 15mb range.