I’ve found it matters what you title the time you block out for yourself. If it’s named “zwily’s Personal Work Time DO NOT TOUCH!!!” then it’s probably going to raise eyebrows. (And I’ve seen plenty of people making blocks like that).
I ended up just naming any times I want to block as “busy”. If anyone had questions or wanted to schedule over it, they would reach out and that was fine.