I don't think culture has much to do with it.
Apple's market cap is over $1 trillion. They sold over 40M iPhones last quarter. They have way more data than either of us do, and the market has spoken: there is not enough demand for small phones to justify a separate SKU.
(Also, as a fellow strap-hanger for 6 years, I just shoved my phone in my pocket and listened to podcasts while riding. But I know everyone has a different use case!)
EDIT: Folks complain on one end about Apple’s lack of product focus and on the other end about cutting out SKUs that do not make sense at their enormous scale.
As much as you all love the SE, it went untouched for years at a time. I imagine there were no components that made sense for the smaller SKU as Apple transitioned to larger phones (and batteries, crucially). It is also a low-ASP phone to begin with, which makes less sense for a company who increasingly makes “luxury” tech products.