If you are free from physical and mental labor, you are in fact, not supplying labor, and are therefore surplus to requirements.
Being rich doesn't mean you can do whatever you want. But it means you can choose not to do what you don't want.
Not everyone can be rich by your definition.
Everyone can be rich. But not everyone can be Montecito-rich.