I have been using keynav (https://github.com/jordansissel/keynav) for convenience for a while now, but still pick the mouse up for selecting text outside of the terminal since dragging is bugged.