However, doing the former requires a level of empathy with humans that LLMs rarely have.
Human brains have caloric demands. It is possible for humans to process enormous amounts of unrelated facts to make a decision, but it’s tiring. It’s much better to not do that, especially just to get some basic information.
To anthropomorphize a bit, an LLM might find it charming and interesting to read someone’s life story as a preamble before their taco recipe. Humans by and large find that annoying, not because we can’t understand the biography but because processing that information is not free.
So it’s probably possible to design using an LLM. You would probably have to be intentional about it.