> Due to that caching, you still need some sort of preprocessor to digest the files and generate an import map.
Why? I haven't needed import maps at all.
> Third party modules also add some extra friction
This is true, sometimes 3rd party JS requires you write a small ESM wrapper, etc, but I haven't found it to be too onerous