Comment by hotpathdev | Hacker News Reader

Top New Best Ask Show Jobs

Comment by hotpathdev | Hacker News Reader

Parent Full thread

I may have missed the detail, but it also expects the pytorch conversion rather than original LLaMa model.

Yes, you need to convert the original LLaMA model to the huggingface format, according to https://github.com/lm-sys/FastChat#vicuna-weights and https://huggingface.co/docs/transformers/main/model_doc/llam...

Reply on news.ycombinator.com