While I like the idea, the reasoning here is kinda silly, even if some developer had sworn such an oath it is entirely unclear how that should affect a AI. We just don't have good techniques to prevent llms from hallucinating.
That point about swearing an oath is a good one. It’s a reasonable position (assuming it’s the court’s position) that an AI (assuming this is an “AI”) being asked to provide testimony or a legal argument is doing so on behalf of all who trained it. Why would “my” training argue in “your” case? What if one doesn’t agree with the oath?
There are clearly gross examples of judges failing in this duty, but others take that duty extremely seriously and I've read a number of judicial opinions on technology-related cases that demonstrated remarkable, nuanced grokking of the matter at hand.