Swapping for a non-dairy fat is trivial and won't really affect the flavour.
It's not like it's hard, if you change what you eat in a few months your tastes and cravings change and you like the new thing just as much as the old thing. But people seem to just get stuck at "but I like this"