Isn't this yet another case of "you have to memorize and regurgitate a ton of information" which people are bad at but something like ChatGPT is exceptionally good at?
This isn't one of those "memorize nothing you can look up" situations. You just have to have it at your disposal before you can do actual medicine.
There may be a day when a computer can do most of the memorization scutwork and you can get back to the real work, but we're not there yet. It's not the test's fault that it's testing medicine as it's practiced today.