> To me, all the lit stuff seemed completely arbitrary and made up. There were no testable hypothesis, no experiments to run. "The author was trying to tell us that ..." - well unless the author actually documented that later, how do you know that with any degree of certainty?
This seems like a pretty common complaint. You seem to assume that literature should work like science. But the purpose of literature is not to rigorously refine a certain predictive model of the world. I don't want to claim exactly what it is, but maybe the telling of human experiences (and the analysis thereof) provides insights that help people better understand the muddier, less quantitative dimensions of the human world? And to that end, it doesn't matter at all whether a claim is based on what the author intended, as long as it provides some useful insight. (Yes, you _could_ use this to justify any claim at all about any piece of literature, and that's part of what this article is about. A lot of people may be "wrong" about what Frost intended, but it's insightful for them anyway, and that's just fine. Typically, academics expect that claims are based on evidence in the text, but that's still subjective and open to many interpretations.)
Similarly, the most effective way to communicate an idea is not always to present it logically and directly. There's the proverb: "If you want to build a ship, don't drum up people to collect wood and don't assign them tasks and work, but rather teach them to long for the endless immensity of the sea." IME, it's almost always more effective to communicate an idea by causing the reader to come to it themselves. That's why narratives can be much more effective at communicating truths about human experiences than simply stating it outright. That's (one reason) why the story of Macbeth is more compelling than just telling someone "your obsession with power may make you miserable".