The problem with social science is that it tries to be a science but in reality its closest relative is product management. Using even the best statistical methods still runs into the keys/lamp post problem. There are too many variables, the variables are not well defined, the variables may have strange interactions, there may be too much noise in the data, etc. In almost all social science situations, you cannot find truth solely through regressions.
For instance, recently I was studying the issue of whether the crash in the stock market caused the fall in consumer spending, or the slow down in consumer spending caused the fall in the stock market. If you run a straight regression you'll have a lot of problems because a) even if the stock market falls first, it could have been because of expectations of future consumption b) the data on expenditures is not collected frequently enough, and c) there are other potentially confounding variables.
But if you take the product management approach you can listen to what people say. And when you listen, you find that people say stuff like, "After the stock market fell, I had to cut back my plans to travel." or "Since the fall in our endowment, we have had to suspend spending on all new projects." By simply asking people you can figure out the causality.
Note that this is how every company in the world makes most of its decisions ( except perhaps Google, because they actually enough controlled data to meaningfully do regressions). When we're trying to figure out what features to build, we do customer interviews, follow-me-homes, surveys, feature requests, talk to customer support, etc. We make very modest use of statistics, because we do not have large amounts of controlled data. Did the customer not use this part of the app because it was not useful, or because we got the label wrong, or because of something else? We could do a bunch of statistics, but what's the point? It won't answer those questions. Asking people may be subjective, but it's the only way (keys/lamppost).
The problem is that social scientists do not get promoted for making accurate judgments and being right. A product manager does. A social scientist/academic can only be judged by his methods. Thus there is the preference within the professions for methods that can be objectively evaluated, and methods that only a select elite can perform. Being right is not part of the selection process for being an academic.