Are you e.g. paying for Google one? I only ask because when I became a real customer I found the process a bit more solid than freemium.

You would hope your address book and some smarts could make a user specific greylist time delay on the spam, but I can also believe their email engine at scale struggles to apply this meaningfully.