I run into this with Dito GAM[1] when handling groups/calendar access. I workaround by just making it try three times. It always succeeds on the second try.

1. https://github.com/jay0lee/GAM