> A good lawyer is not just knowledgeable of law, but of people. He needs to get 12 people in front of him to agree with him.
While I agree with you that AI powered lawyer can have many downsides and drawbacks here you are building on a falsehood.
There is this illusions that computers are "book smart" but not "street smart". It is very deeply ingrained into our culture. Just think about Data from Star Trek. Very analytical, but struggles to understand emotions. Therefore also struggles to manipulate people's emotions, aka being emotionally persuasive.
This is a sci-fi trope, but is false as it comes to these generative models. (or can be false depending on training data) If you train the system with mock juries it can learn how to twist them around its finger. Text written by such a model can be as emotionally persuasive as one written by the best lawyer.
In fact in reality, as the tech is today, it would be easier to reliably implement the "reading reactions, and understanding what each of those 12 people needs to hear to have them act like he wants" part than the "follows flawless logic, legal technicalities to a T" part.
It is of course still a very perilous path to make an AI-powered lawyer. It is just important to not base our reasoning on sci-fi tropes