You can turn it off for external displays, it requires a few steps because you're weakening privacy protection.

Check https://support.apple.com/en-gb/118449