Apparently desert sand is no good for making concrete, because it's been smoothed and rounded by the wind. I'm guessing moon sand wouldn't have such a problem. Although you'd have to solve the problem of re-entry into the Earth's atmosphere. How practical are space elevators?
A lot of Dutch companies get their sand from the bottom of the sea, though. Plenty of sand there.