Not sure what you mean, but if you're talking about auth'ing to Google Workspace with an external IdP with SAML (here is being talked about auth between the client and Google, like say with IMAP, over OAuth, which in turn can use whatever, including SAML), then no, you have nothing to worry.