I hear this logic a lot and disagree. Finding more sensible and environmental ways to produce electricity needs to be the goal because we cannot be more sustainable. Mankind thrives on energy. I think the past 263 years (since Franklin's kite experiment) have shown us electricity is a way of progressing. We need power to run things. Where that power comes from is the difficult part. Unless another form of energy is found that can be used to work everyday devices from phones, to computers, to lights, not sure how we get away from electricity and only continuing to increase its consumption.
As for paneling the desert - The massive solar arrays in the Mojave desert outside of Vegas show that the sun can be used effectively, but the cost to produce the materials and impact on desert flora/fauna that go into the arrays are just as bad for the environment. The material cost alone in terms of environmental impact make it a laughable endeavor in terms of "environmental" concern.