The Vikings were themselves a farming society. So this has nothing to do with the postulate that non-farming societies would overrun farming societies -- I'd look for a different example.
The same way I do chores, but I'm not a house maid (until perhaps I quit my job)
Examples: Vikings, Barbarians, Huns, ...