chatgpt is obviously a LOT better, llama doesn't even understand some prompts
and since LLMs aren't even that good to begin with, it's obvious you want the SOTA to do anything useful unless maybe you're finetuning
and since LLMs aren't even that good to begin with, it's obvious you want the SOTA to do anything useful unless maybe you're finetuning
This is overkill. First of all, ChatGPT isn't even the SOTA, so if you "want SOTA to do anything useful", then this ChatGPT offering would be as useless as LLaMA according to you. Second, there are many individual tasks where even those subpar LLaMA models are useful - even without finetuning.
even for simple tasks they're less reliable and needs more prompt engineering
GPT-4 beats ChatGPT on all benchmarks. You can easily google these.
even through the API you can't easily use the regular models for chat, the parsing would be atrocious and there are hundreds of edge cases to handle.
ChatGPT4 through the API is the SOTA