One of the reasons is that people don't know what to do with themselves after they make passive income? Therefore you shouldn't aspire to make passive income? LOL.
Passive incomes means financial independence and freedom to make life decisions independent of monetary compensation. Financial freedom means having leverage in the business of life. That's hugely valuable and worth aggressively pursuing in my opinion. You can always find and pursue your passions after that.