I suppose it depends on the ratio of masters to slaves in your hypothetical 5000 person town.

Your context, after all, is a global catastrophe that would require local self-sufficiency. That implies the isolation that would enable human nature to take its course.