The main thing driving me away from Firefox is the speed. Chrome is notably faster for me.
Personally, I’ve found all the browsers to be fast enough.I did some analysis leg work to come to that conclusion. I look at other characteristics such as privacy.