I work on the linux kernel using CLion and the IDE is still fast. I would not be interested in a non-Java IDE for the performance.
I'd be interested in even lighter than VSCode IDE ;)
Like, change a file outside of the editor, open it again, and it’ll sit there stuttering for a bit while it realizes the file is updated and it has to re-index.
It’s not the end of the world, but the experience there could be more fluid. Because you do this often (e.g. every time you switch a git branch)