Evaluating ChatGPT's Information Extraction Capabilities: An Assessment
arxiv.org
arxiv.org
- "ChatGPT’s performance in Standard-IE settings is not as good as BERT-based models in most cases. However, ChatGPT achieved excellent accuracy scores in the OpenIE setting, as evaluated by human annotators."
- "ChatGPT could provide high-quality and trustworthy explanations for its predictions. One of the key issues is its tendency towards overconfidence, resulting in low calibration."
- "ChatGPT exhibits a high level of faithfulness to the original text, indicating that its predictions are grounded in the input text."