Buddha was as you say a prince, renouncing wealth is a move only available to someone who has wealth, and he could have gone back.
Epicurus owned a garden and the leisure to sit in it.
Diogenes I can kind of buy about but he still lived off a slave-owning city that had surplus to spare.
Also none of them had kids or other dependents to take care of.