Patronizing comments like "Have you had enough quiet time today?" are anything but innocuous. That would be a huge red flag for me that the relationship is unhealthy. There's no reason to tolerate such overt disrespect.
That sounds the like the response someone would make after hearing "I just need a bit of times to myself" quite often.