Out of curiosity: what’s slow with your config?
Emacs is slow. Even with native compilation. Even with the default or a minimal config. Opening files or switching buffers, imenu, isearch, etc especially in files of a few thousand lines or more, have a noticeable UI grogginess to them.
It's probably only dozens or maybe hundreds of milliseconds but it's very clearly there and always has been on every system I've used emacs on for nearly 20 years now. I do not understand emacs people who claim it isn't, or try to make it a "you're using it wrong" matter based around my config. Your config can certainly make it much worse, but you can't config it out of emacs it is part of the software.
Vim definitely starts up faster. But to make it more comparable, do you consider “emacs -nw -Q” slow too? What do you get for “time emacs -nw -Q -eval '(kill-emacs)'”?
I am basing this entirely off of how it feels to use the tool, rather than measured timings, because I am a person who feels and not a clock that measures.
I also don't care all that much! Emacs is slow and also still the best tool for many of my uses. If it's unbearably slow for a given task I just use something else for that.