I loved the iPhone SE and small phones generally, but at the same time I realize Apple's not failing at anything. They're giving the market the size people actually want. The smaller phones don't sell nearly as well. Most people prefer a bigger phone even if carrying it is less convenient.
I've just accepted my phone will be bulky now, so I double down and attach a magnetic wallet to it, and carry it in my hand or jacket pocket or bag rather than my pants pocket like I used to. During meetings it lies on the table rather then in my pants pocket. C'est la vie.