152 karma · joined February 19, 2022
https://gist.github.com/Enoch2090/5026c417f86ff6ff4fbe30c22b...
1. The chat context is always provided, and that introduces a bit of uncertainty - when the chat history mentioned something the model is always inclined to connect with it.
2. When I tried to set each context to an empty string, the model doesn't show any evidence of remembering concepts. I told it 5 times that I love cats, and when asked about its favorite animal, its output remains "honeybee" and "octopus".
Not sure whether there are anything similar for SD though.
As for the documentation purposes it should be the programmers/authors' duty to ensure that the code works out by executing all cells in order once.
1. Generate embeddings using services such as OpenAI, which is usually more powerful;
2. Generate backup embeddings using local, more stable models, such as Llama2 embeddings or simply some BERT-family-model (which is more affordable).
When outages comes up you simply switch from one vector space to another. Though possible, model alignments are much harder and more expensive to achieve.