Smaller phones can’t fit as much stuff in them as larger phones. Shrink the phone and something has to give. People in the aggregate do not want to make those compromises unless the price is noticeably less. But then it can’t have any of the premium features that are expected from Apple. Small phones are compromises that don’t pay off for Apple.