Now I tried it and don't see the reason to. I mean there is no rush. Regular house/flat will give you 80% of value of multimillion dollar mansion will give. Cars are all +- the same given that you can drive only so fast. Travel when you need to work is too hectic but if you are retired it can be very inexpensive. In order to push past this middle level it is not clear what to do i.e. difference between 1M and 10M is not that big in terms of your lifestyle but ability to accumulate so much is completely different beast.
The true happiness comes from other things: friends, family, free time, the business you love, curiosity etc.
UPD: This is all of course if you were able to get into good career/small business path. If you are stuck with some low-pay job you still have some work to do to jump to another industry.