This will probably be about as responsive as this can get without a low latency audio driver.

At least on Windows, this is similar to the latency when using a MIDI keyboard and a DAW with non-ASIO/WaveRT audio drivers. I think for Linux the analogue would be higher-latency with PulseAudio than with JACK.