Udo, I think you are onto something here. An important aspect of
going minimalist is getting rid of (so called) superficial possessions. That means, to a large extent, only those who have
stuff to get rid of can do so as a part of
going minimalist.
The second important aspect is taking care of basic needs of daily living: food, clothing, shelter, healthcare (when absolutely needed). For someone engaged in the daily struggle to have such basic needs satisfied, the very idea of getting rid of anything they possess would be an anathema.
Clutter and hoarding are, thus, in (some ways) the unintended results of that struggle. Every item that has been acquired by (very) hard labor, or (minimal) lucky breaks is, from that point on, almost a lifeline. The question: What if I need this again? rings out every time an item is about to be discarded.
However, the other side of the same argument is the definition of needs (as opposed to wants). There are always going to be genuine needs and the point of comfort one feels with their net worth in satisfying those needs is going to define the point at which fear of the unknown ceases to be a driving factor in their decision making process. Including the decision to go minimalist.
That point is, understandably, different for everyone of us. In the end, I feel, it is easier to make the minimalist choice with (a). a solid net-worth (bank balance, property etc.) OR (b). absolute courage when a sense of security is lacking such as when (a) is absent OR (c). a combination of (a) and (b).
------
TL;DR : I think, it is easier to be minimalist if you are materially secure; have sufficient support for a minimalist lifestyle from your life-partner or rugged courage and self-confidence if you are single/dependent-free.