The model is compiled for apple silicon/metal with 4-bit quantization using mlc-llm https://mlc.ai/mlc-llm/ which uses TVM Unity https://tvm.apache.org/ under the hood.
506 karma · joined October 9, 2018
The marketing copy for the app store was generated by the same model (vicuna v1.5 7b) that is used in the app itself by hardcoding the prompt inline and running it locally.
-xu yun
I don't know about this one, HR (or the lack thereof) in silicon valley has a pretty strong track record of evil.
https://www.nytimes.com/2018/10/25/technology/google-sexual-...
https://www.nytimes.com/2016/02/18/technology/zenefits-scand...
https://www.bloomberg.com/news/articles/2017-02-27/uber-like...
https://us.macmillan.com/books/9780374157357/thedawnofeveryt...