Paying a bit more for a better item which can be repaired or serviced for a very long time makes it cheaper in the long run in my experience, because you buy it once and for life.
I love "overkill items for everyday life" point of view, but it comes with trade-offs for noise, ergonomics, size, replaceability and such. You can get a very good blade from Victorinox or Leatherman. If you fancy good steel, you can get a high end, forged German steel Victorinox chef knife and use something frighteningly sharp and handsome at the same time.
If you want a good heater, you can pay twice the price and can get a Fakir Hobby premium space heater and can use for 30+ years (we have two).
The list can go on.