Mmm. Modern fertilizer has done a lot to neutralize the importance of good soil. You can't farm rocks, but the US west has done a lot with sand + fertilizer.

As long as you have money, water, sun, heat, and something better than bedrock, I wouldn't call it unrealistic.