The market, in both Android and iOS land has dictated larger phones are more favored. This is abundantly clear with the advent of "foldable" phone sector. On paper foldable phones make no sense, they are less resistant, more expensive and use a plastic screen, yet the market is growing year on year.
I totally respect someone's opinion on a small or large phone, but even the largest iPhone is fairly easy to hold and operate using one hand. I don't have big hands.