Good question! I would disagree that intuitionistic reasoning is blessed as the "universal reasoning". As you say, there are other even weaker but still useful systems around.
It is just a fact of life, without any room for philosophical preferences, that the largest common denominator of all toposes is exactly intuitionistic reasoning, not more, not less.
But there are, besides toposes, also other kinds of mathematical structures which can be regarded as mathematical universes! And the largest common denominator of those other kinds can be more or less than intuitionistic reasoning.
Going up, we have for instance models of ZFC. By definition, their largest common denominator is ZFC, so more than intuitionistic reasoning.
Going down, we have the so called "arithmetic universes". Their largest common denominator is "arithmetic type theory", a predicative flavor of intuitionistic reasoning. (To a very rough first approximation which doesn't at all do justice to this intriguing topic, "predicative" means "no powerset axiom". The terminological convention is that by default, "intuitionistic reasoning" refers to impredicative intuitionistic reasoning.)
And then there are a couple other kinds still.
That said, toposes with their impredicative intuitionistic reasoning do occupy a sweet spot. They are sufficiently general to yield useful applications in several branches of mathematics while not being too general.