If you ask my dad, I am 100% sure he would tell you I have ghosted him. In reality, I told him repeatedly, over the course of years, that if he would not speak to me with at least a base level of civility, I would stop talking to him, and then when I did stop, I ended with, "Because you continue to refuse to speak to me with at least a base level of civility..."
And it's not like I just put up with it for years. Each time, I would go slightly longer without speaking to him. But eventually I would guilt myself into, "But he's your father. You have to try again." But it didn't matter how long the break was. Nothing changed. So I finally realized there was no more good to come of being in touch, told him so, and cut contact.
I imagine a lot of people have this experience with narcissists. And if they see your action as "ghosting," so be it.