I would be cautious about drawing such a conclusion. I think if you were a typical neolithic farmer you would not be looking yearningly at the hunter-gatherers living in the mountains, wishing you could live like them. You'd probably feel that their life was pretty hard.
If anyone wants to learn more about the realities of life for nomadic hunters, I'd recommend Elizabeth Marshall Thomas's The Harmless People (http://www.amazon.com/Harmless-People-Elizabeth-Marshall-Tho...).