Efficiency matters of course but it's just one of the variables in the equation.
The thing about solar energy is that the source is so powerful and abundant that the dominant factor for its economical viability is our ability to produce devices to capture it.
When nuclear is getting more expensive over the years(as the completely safe reactors prove to be not that safe and more safety is introduced), the devices used to capture the solar energy have been getting cheaper and cheaper. So it doesn't matter if solar is half the efficiency of something else if we can make the devices to capture the solar 10x cheaper.
Solar has already become very cheap, what we still need to do is to figure out the storage. So far the success is limited but because all life on earth is doing it already, I think it's a solvable problem.