From a58c1ee8633a4f248d2c6cb2aa9078c6d6ea5544 Mon Sep 17 00:00:00 2001 From: tslmy Date: Sun, 2 Jul 2023 15:41:03 -0700 Subject: [PATCH] Update model file name in `examples/alpaca.sh` The original file name, `ggml-alpaca-7b-q4.bin`, implied the first-generation GGML. After the breaking changes (mentioned in https://github.com/ggerganov/llama.cpp/issues/382), `llama.cpp` requires GGML V3 now. Those model files are named `*ggmlv3*.bin`. We should change the example to an actually working model file, so that this thing is more likely to run out-of-the-box for more people, and less people would waste time downloading the old Alpaca model. --- examples/alpaca.sh | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/examples/alpaca.sh b/examples/alpaca.sh index aef207f364797..8d2bae6918b62 100755 --- a/examples/alpaca.sh +++ b/examples/alpaca.sh @@ -7,7 +7,7 @@ cd `dirname $0` cd .. -./main -m ./models/ggml-alpaca-7b-q4.bin \ +./main -m ./models/alpaca.13b.ggmlv3.q8_0.bin \ --color \ -f ./prompts/alpaca.txt \ --ctx_size 2048 \