You can send 50 rockets individually to the moon to deposit fuel and use it as a refueling/relaunching point. 50x fuel can't go up with the passenger-laden craft in the same way.
True but storage is an issue and as I said in another comment, Project Orion-type endeavors become more palatable when launched from a stable orbiting rock rather than empty space or a manmade platform.