Understandable assumption if you haven't been paying attention to Apple and privacy, but incorrect:
https://www.apple.com/legal/privacy/data/en/sign-in-with-app...
>When you use Sign in with Apple on Safari, Apple sees when you sign in to a website so that Apple can authenticate your sign in, but Apple does not retain a history of what websites you sign in to or when you use Sign in with Apple.