Alas, it still fails at my favorite music theory question. I've yet to see a chatbot get this right, even though it isn't a trick question at all.

I ask:

"Consider a tenor ukulele in standard tuning. If we tune it down by a half step, how might we then finger a Gmaj7?"

It initially reasons correctly that this must be G-B-D-F# and it understands what the resulting strings will be tuned to if we drop them a half step. It just can't work out a valid fingering, and ends up getting confused and suggesting a nonsense chord.