(disclaimer: I work on Flutter.) Flutter uses its own renderer based on Skia. Flutter essentially asks the OS for an surface to draw onto, and then Flutter draws all the pixels through Skia.
In such case, this is what I feared; I don’t think it is possible to implement proper VoiceOver support with the current public API.
You should file bug reports with Apple to enable that.