Right - the pageload time only matters for certain sectors. We sell sports science equipment and our competitors have 10s load times; I'm sure they have no issue selling their stuff. If they got their load times down to ~1s I bet they'd sell more... but not that much more. We are in the 1.5s-2.0s load time and I'm happy with that; given we use Woocommerce to drive our traffic I highly, highly doubt I can get it much lower given our current site design which does very well engagement-wise. That's fine for us; our conversion metrics and related analytics show that we're doing very well for our industry.
For niche equipment you're either gonna buy it or you aren't. If it isn't Amazon, Google, Wal-Mart, or places where you are preying on impulse buys (Woot, LowEndBox/VPS, etc), then the page load times matter a hell of a lot less than something like user design.