For whatever is worth, I had similar experience. The thing, calories deficit means you are passive, tired, irritable, have problem to focus. So you are less effective at work too. How bad the irritability is for others I understood only when someone else was dieting and turned into someone constantly angry.
In addition, if you diet only, it is very easy to cause yourself annemia or other health issue. It happened to me and it actually affects life a lot. Most of sources talk about what you should not eat, but very little about how to recognize you are missing something or overdoing it.