If all you test is the layout then, for the most part, you are Right! Right! Right!
But...
Even with little traffic, you can still achieve significant gains by focusing on the copy as opposed to the layout and colours.
I learnt this mostly with Adwords. At the prices they charge now, you just have to find the gains wherever they are.