A quick search for "linux local privilege escalation" in the CVE database (https://www.cve.org/CVERecord/SearchResults?query=linux+loca...) shows 25 results just for this year, so clearly these are very common.
So basically we have two issues here:
1. either focus on security even though these changes don't really improve the threat model
2. or allow disabled users and anyone who uses accessibility features to use GUIs