For me, the killer was a combo of 3 things: 1. Too expensive relative to performance. 2. Availability of quite decent N100 (and similar) boxes with expandable memory and storage. 3. Not interested in Pi that should be actively cooled.
I always wished the Pi had eMMC storage but it never happened for the non-compute module versions.
I still have a few Pi’s around the house and they are plenty powerful for their purpose.