qwen.cpp icon indicating copy to clipboard operation
qwen.cpp copied to clipboard

Qwen-7B-Chat WSL GPU Error: ankerl::unordered_dense::map::at(): key not found

Open dlutsniper opened this issue 2 years ago • 2 comments

Qwen-14B-Chat is OK, but Qwen-7B-Chat is Error: ankerl::unordered_dense::map::at(): key not found WSL OS: Ubuntu 22.04.3 LTS GPU: NVIDIA T600 Laptop GPU

ankerl::unordered_dense::map::at(): key not found

图片

dlutsniper avatar Oct 23 '23 07:10 dlutsniper

Script:

pip install tiktoken
pip install einops transformers_stream_generator

python3 qwen_cpp/convert.py -i /mnt/d/dev-llm/models/Qwen/Qwen-14B-Chat -t q4_0 -o qwen14b-ggml.bin
  qwen14b-ggml.bin
    7.42GB
python3 qwen_cpp/convert.py -i /mnt/d/dev-llm/models/Qwen/Qwen-7B-Chat -t q4_0 -o qwen7b-ggml.bin
  qwen7b-ggml.bin
    4.04GB

cmake -B build -DGGML_CUBLAS=ON
cmake --build build -j

./build/bin/main -m qwen14b-ggml.bin --tiktoken /mnt/d/dev-llm/models/Qwen/Qwen-14B-Chat/qwen.tiktoken -i
./build/bin/main -m qwen7b-ggml.bin --tiktoken /mnt/d/dev-llm/models/Qwen/Qwen-7B-Chat/qwen.tiktoken -i

dlutsniper avatar Oct 23 '23 07:10 dlutsniper

解决了吗,一样的问题

zzzcccxx avatar Feb 01 '24 06:02 zzzcccxx