Paleo is a little overzealous IMO, as I don't think there's really a problem with some dairy, some rice, and fruit here and there. All of the foods you mentioned are better than a typical high carb, high sugar diet. I think the main value of any diet, whether it's paleo, Atkins, South Beach, etc., is that they are low sugar. It's really sugar, in my experience, that is a major contributor to keeping people overweight and hooked on unhealthy food.

However, I would encourage you to do some research and test your assumption that people shouldn't eat much fat(which seems to be what you're implying).