If people can do whatever they want, does that include those running the robots?
Because if I'm a robot operator and you can do whatever you want, then I know I'm not going to get anything of value from you. So why should I work beyond Tuesday to make stuff that you need to live? I may as well go home and be 'free'. Your money is literally worthless to me.
We know what everybody doing what they want leads to. It leads to land redistribution and hyperinflation - as demonstrated in spades in Zimbabwe.
Unless you are completely self-sufficient then you have to look at the systemic impact of your idea on everybody. Then you'll find it has a severe fallacy of composition in it.
The mega rich get away with it simply because they have a slave class (the rest of us) to do their bidding. If you can do whatever you want, who is the slave class working more than they need to to service your needs?
To maintain an advanced society we need the robots working 24x7 and the land worked 24x7. To get people to give up their time to do that you have to give them something in return. Money isn't enough. That is the service to others you have to do if you want the carrots others grow.
As Ali said: Service to others is the rent you pay for your room here on earth. What we lack is a mechanism to allow people to make that rent.