> why not make the shitload of money first

Because it is very very hard to get to "fuck you"-money and passive income often isn't quite as passive as it seems.