In law school, most lawyers are taught to present each argument in a standard format called IRAC: Issue, Rule, Analysis, Conclusion. The issue is like the question presented on the front page here: "can courts pierce the corporate veil where a corporation has misappropriated funds?" ROSS spits out the relevant rule, and any information it can find on how to interpret that rule in specific situations. However, this is only the beginning of a lawyer's job. The largest part is taking that rule and actually applying it to the facts of the specific case. ROSS doesn't seem to be able to do this, yet. Finally, and least importantly, the lawyer comes up with a conclusion (or a series of probability-weighted conclusions). ROSS doesn't seem to be able to do this either. In law school and in court, it's not enough to cite the rule of law. It's much more important to apply the reasoning of the rule to every specific fact in the specific case.
It would be very interesting to see this intelligence applied not just to legal research, as here, but to e-discovery, which is the other time intensive task given to associates and contract attorneys. That would, I think, be the next step into turning this into a general purpose attorney that _would_ be able to handle the analysis and perhaps conclusory stage of a legal issue.
If anyone who worked on ROSS is here, where did you purchase your corpus from? West or lexis? How are you doing shepardizing and pruning of bad law?