Same. Have perfect video chats with AirPod pros.
At 200ms interruptions happen more often and the flow of a conversation can't be maintained as well. But you might just chalk that up to "video chats are not very good anyway." Latency punishes the person you're talking to, who sees more interruptions, not necessarily just yourself.
edit: I note you're in Australia. Perhaps your baseline latency is already fairly high. But that should make this issue even more important.