Android voice access blogged about how they use a model to detect and classify buttons:

https://ai.googleblog.com/2021/01/improving-mobile-app-acces...