That's understandable, and so perhaps that we need to re-think our computing model to replace yes/no popups with something a bit more involving.

By "involving" I do not necessarily mean harder, the goal isn't to make computers less accessible, but if we give users the ability to control whatever go in and out their devices maybe that making them a bit more interactive so instead of clicking "yes" to allow keyboard access you could drag a keyboard icon to the app or any other device you want to use as input instead.

Consent doesn't need to be presented as yes/no, there are multiple ways to make users understand what is being accessed.