OpenLLM icon indicating copy to clipboard operation
OpenLLM copied to clipboard

output "killed" with nothing else

Open Songjc0511 opened this issue 2 years ago • 2 comments

Screenshot from 2023-10-30 17-15-38 I tried use OpenLLM with my merged Llama model, and it print two lines of "Special tokens have been added in the vocabulary, make sure the associated word embeddings are fine-tuned or trained.", and then, KILLED.

Then I used just llama model, and it just print KILLED

is anything I did wrong?

Songjc0511 avatar Oct 30 '23 09:10 Songjc0511

python 3.9 cuda 11.8

Songjc0511 avatar Oct 30 '23 09:10 Songjc0511

what version of openllm is this?

aarnphm avatar Nov 08 '23 09:11 aarnphm

close for openllm 0.6

bojiang avatar Jul 13 '24 05:07 bojiang