If you are thinking the difference is negligible, you are thinking only about things you can buy right now. Imagine you want to buy:
Rockets (Bezos, Musk)
Curing aging (Ellison, Bezos, Page, Brin, Pineapple Fund)
Curing malaria (Gates)
Or something on a lesser scale:
Seed funding to startups (Graham)
App to display wind for kitesurfing (Lukacovic)
Remember the last frustration you had with software, hardware or your hobby? Imagine you can solve it for yourself and others just by throwing money on the problem. There is a saying, that the rich are just frustrated mariners, all they want is a larger boat. If you are in that category, then yes, your lifestyle difference won't be large with a $100m and $1b