Everyone not in a particular field asking LLM about said field is rolling bad dice.
Everyone not in a particular field asking LLM about said field is rolling bad dice.
If you have it ask for involved legal documents to give to a lawyer like 100% of the time they find problems with it. And someone who isn't in law would have not known any better.
When you have it write complex code that is not easy/quick to test, especially things that are specifically NOT concretely defined, like net-code (because it's all on the trade-offs you want to accept for your particular game), it's going to just repeatedly create sync issues.
I've asked it to write-up a detailed explanation of the different types of turns in 4-panel dance games and it's just permanently wrong no matter what I say.
The more unique and lacking of training data that exactly represents the problem statement the more impossible the statistical machine will generate text that makes sense.