The guilt isn't due to the simple fact of being prosperous it's more about the prioritization of self-interest over that of a win-win option that helps the broader good.
If it is self made you presumably made it by creating value for others, otherwise why would anyone pay you?