PyGaze – open-source eye-tracking software and more

For many pieces of software it's possible to use it with a keyboard-only. This is neccessary for accessibility, but it's also just what the good old hotkeys do.

Doesn't work for everything but it already gets you very far.

On top of that, there is some software that is made to cater specifically to keyboard-only use. Many tiling window manager work well with just a keyboard ( I personally am partial to i3[0]) and even for webbrowsers there are extensions like tridactyl[1] that make it easier to use without a mouse. That doesn't work for everything. It's possible to do 3d work without a mouse - but I find it easier to have access to a mouse. Specifically a trackpad.

This can of course be turned on it's head, and you can use something like dasher[2] to do your typing and - to get this back on topic - dasher can be used together with eye tracking to live a "keyboard free life"

[0] https://i3wm.org/ [1] https://addons.mozilla.org/en-US/firefox/addon/tridactyl-vim... [2] https://dasher.acecentre.net/ [3] https://www.inference.org.uk/djw30/dasher/eye.html

Eye trackers are an incredibly common tool for research. They're obviously useful for studying eye movements themselves. This may sound niche, but eye movements are tightly integrated with perception and attention. Eye tracking can thus tell you about the features or cues that help (say) hit a baseball, read some text, or find a tumor. Experts in a field often make different patterns of eye movements than novices, so there are some nascent efforts at using eye tracking to help training (e.g., "no, keep your eye on the ball").

On the application side, they have potential as an interface device too: you can make eye movements incredibly quickly (80-100ms, under some conditions) and accurately. This persists even in some neurodegenerative conditions.

Foveated rendering is another neat idea. The fovea, the "high resolution" part of your retina, is surprisingly small: it captures a thumbnail (at arms' length) sized region of the world around the point of gaze in color and detail. Outside that region, the visual input is increasingly blurry and colorless. It doesn't seem that way because your brain assembles percepts by making many eye movements (2-4 per second) stitching the input together. One popular idea is to exploit this when rendering images (e.g., for VR): spend most of your cycles making the point of gaze pretty and provide just enough elsewhere to complete the illusion. Doing this obviously requires knowing exactly where a person is looking, and thus, an eye tracker.

Outcome: artists are more likely to track away from obvious points of interest. So in the case of a portrait, the artist might be looking at a brick by the subject's feet, whilst everyone else's gaze would be fixed on the subject's eyes.