For space-based solar to be efficient, ie for it to be better than just installing normal solar panels, the beamed energy would have to be at least as powerful as sunlight1) False. You just have to find contexts where installing solar panels is undesirable or impractical. A forward military camp in the hills of Afghanistan?
2) It's quite easy to exceed the energy density of solar panels with a microwave rectenna to receive power. In fact, a lot of the old designs were dedicated to reducing the power density for safety reasons.
One might say that space-based solar would operate 24/7 and so is better than normal solar panels. That's isn't reality. Low-orbit satellites spend half their day in darkness too.
Zero cloud cover. Zero dust buildup. In terms of access to solar flux, there are a lot of advantages to being in orbit. Also, there's a "simple" way to get around the tyranny of the rocket equation and get stuff to geosynchronous orbit cheaply: mine the moon, manufacture the silicon solar panels there, and use lunar electromagnetic mass drivers to deliver bulk cargo to geosynchronous orbit. So I would agree with a lot of what you're saying about impracticality with that caveat: "short of having lunar industrial infrastructure."
But, given a major power that has the above, how is this so different from having fusion power?
EDIT: But if you carry forward this thinking a few steps, you get to...Oh NO!
So let's say that we don't get fusion power, but we do get to the point where lunar industrial infrastructure looks within reach. In that case, control over lunar resources will mean control over the most plentiful, clean, and convenient form of energy. Basically, more than half of the motivation behind major power wars in the last century and a half, has been control over resources, particularly energy. Having energy resources gives one military power which gives control over energy resources.
This dynamic would seem to set up the next major power conflict past the Taiwan issue. Space could well wind up being the Caucasus Mountains/Persian Gulf of the early to mid 21st century. A major power conflict over energy resources which fundamentally involves the power densities implied by space travel just seems like BAD NEWS.
Even worse. We first get the start of the above conflict. Then only afterwards does rapid wartime R&D finally yields military grade fusion power. Yup, we're living in our really nifty, really interesting Sci-fi future. "May you live in interesting times."