My very close friend and his wife gave up after years of treatments. My sister and her husband are coming up on years of unsuccessful treatments. Several of my wife’s close friends either required treatments, have lost one or more pregnancies, and/or have yet to succeed with treatments.
It’s more than enough to make you feel like there is something serious going on. There was an article recently about aggressive drops in male fertility, which might shed light.
In my mind, the other big piece is readiness / pressure. I don’t think it’s everything, but I do think there must be a huge mental component to conception. The people who are more financially stable and on the same page seem to have the easiest time.