They studied what happened to people who switched to agriculture 11000 years ago, via the fossil record. Also you can watch what happens to people who lived in a traditional way and then entered society.

That way I think a lot of things you mention can be excluded - not that lead and fire retardants are not dangerous, but that is another area of problems.