Jumping onto this: what about accessibility? On iOS at least, if you use the native controls you get a ton of accessibility support either for free or with relatively little effort. VoiceOver has some really deep hooks into the system.
How, if at all, does this work with Flutter? Seems like it would be like trying to get a screen reader to describe a game.