The scale.
The reason to build a Dyson Sphere (or Swarm) is that you want all (or at least a large fraction) of the energy output of a star. To "build decentralized fusion reactors" that can provide the same scale of energy is even less practical than building a shell around a star and would require far more materials! Also, fusion is really simple when the ignition energy is provided for free by the gravitational compression of something the size of a star, and not so simple when you're trying to get it started on a small scale using any other form of energy for ignition. The bottom line is we don't really know if small-scale, controlled, net-energy-positive fusion is possible at all, but if it is it has a lot of overhead costs... you then have to deal with ignition energy, containment, etc. You're trying to make a mini-star and keep it tame. The physics are not favorable to this, they are favorable to star-sized stars, where gravity and fusion energy pressure can balance each other for millions of years.