A big issue here are mobile/touch devices.

You don't want to force your users into keyboard driven interaction there.

But as decent mobile support is almost a requirement nowadays (even if just inside the browser), you end up with two completely different interaction designs and would require users learning everything twice.