Except that you are. There are plenty of old people in London and the South East with very modest pensions that live in homes that have exploded in value through no fault of their own. They are not wealthy they just happen to live in a home that has become expensive.
I don't know if you have seen how confused a someone with dementia becomes when you move them to a new environment but it can be pretty horrible. And cheerfully saying that now this formerly independent person has to now pay for care because you took a policy decision is cruel.
The solution to a problem with society is not to hurt other people. This isn't a zero sum game where pain should be apportioned. We could actually come up with solutions that help everyone. Like simply building more homes...