They're poor at recollecting the exact descriptions of the ~150,000 ICD codes, which is why these other approaches [1,2] give the known information (codes) in some way to the model and let it do the task of _assigning_ them to discharge notes, which is the hard part of the task!.

(Disclaimer: I am an author of one of these papers)

1. https://arxiv.org/abs/2311.13735

2. https://arxiv.org/abs/2310.06552