Have you got the automatic adjustment off? The night time thing hadn't bothered me.

https://support.apple.com/en-au/guide/mac-help/mchlp2265/mac