This works nicely when you mainly just using a text editor to edit files in a scripting language and doing any automation stuff from terminal.
If you find yourself using a big IDE it can sometimes be a pain. Most IDEs will let you do remote debugging etc but will still build on the local machine and do use the local JVM to enable some features.