572 karma · joined October 17, 2017
1. Sometimes constraints can decrease the quality of the output since syntax of the response is prioritized more than quality of the response 2. For memory constrained inferences, certain sampling strategies like top-k can cause OOM errors if the max_token is too high. I haven't tested that it is entirely due to structured generation but I suppose it is possible for certain regexes. 3. Vision models and other multi-modal models are not supported yet.
Apart from this, closed models also have json output but I am not sure how consistent they are
1. https://platform.openai.com/docs/guides/text-generation/json... 2. https://docs.anthropic.com/en/docs/build-with-claude/tool-us... 3. https://ai.google.dev/gemini-api/docs/api-overview#json
https://github.com/microsoft/Phi-3CookBook/blob/main/md/04.F...
For instance, the generational leap in video generation capability of SORA may be possible because:
1. Instead of resizing, cropping, or trimming videos to a standard size, Sora trains on data at its native size. This preserves the original aspect ratios and improves composition and framing in the generated videos. This requires massive infrastructure. This is eerily similar to how GPT3 benefited from a blunt approach of throwing massive resources at a problem rather than extensively optimizing the architecture, dataset, or pre-training steps.
2. Sora leverages the re-captioning technique from DALL-E 3 by leveraging GPT to turn short user prompts into longer detailed captions that are sent to the video model. Although it remains unclear whether they employ GPT-4 or another internal model, it stands to reason that they have access to a superior captioning model compared to others.
This is not to say that inertia and resources are the only factors that is differentiating OpenAI, they may have access to much better talent pool but that is hard to gauge from the outside.
I understand that press releases are intended for non-technical folks but I don't get the point of this description. Is it assumed that machine learning is less understood than artificial intelligence?
If we can perfect methods to fine-tune large models for specific task while reducing the overall model size, then it can fit into more consumer grade hardware for inference and can be broadly used. The objective is to prune unnecessary trivia and memorization artifacts from the model and leverage LLMs purely for interpreting natural language inputs.
I have been wanting to cancel the subscription for months now but just got around to do it. I wonder what percentage of the current subscribers want to get rid of the subscription but simply couldn't bring themselves to do so.
This happens to me irrespective of whether I went through the painful learning curve just recently or several years in the past. Once I am comfortable with a topic, I cannot approach it from a newcomers perspective.
So I think having a systematic approach to KT and training will help.
1 - http://www.cesaremarchetti.org/archive/scan/MARCHETTI-052.pd...
But I am told that there is no such problem in Teams with enterprise SSO. Also I have other friends who are quite happy with it. Personally, I can empathize more with OP. MS Teams is a terrible software which seems out of place among the modern era clients.
https://youtu.be/vSnCeJEka_s - The death of Agile - Allen Holub
I can’t say whether it is worth the subscription fee. I have got my employer to cover for my subscription for the last 2 years, but not sure if I will be willing to pay it out of my pocket.