Describe the issue
(qwen25) root@n-217:/data/wen/test# python /data/wen/test/llmlingua-2/test.py
Traceback (most recent call last):
File "/data/wen/test/llmlingua-2/test.py", line 11, in
results = compressor.compress_prompt_llmlingua2(
File "/root/anaconda3/envs/qwen25/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 926, in compress_prompt_llmlingua2
compressed_context, word_list, word_label_list = self.__compress(
File "/root/anaconda3/envs/qwen25/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 2372, in __compress
words, valid_token_probs, _ = self.__merge_token_to_word(
File "/root/anaconda3/envs/qwen25/lib/python3.10/site-packages/llmlingua/prompt_compressor.py", line 2264, in __merge_token_to_word
elif is_begin_of_new_word(token, self.model_name, force_tokens, token_map):
File "/root/anaconda3/envs/qwen25/lib/python3.10/site-packages/llmlingua/utils.py", line 100, in is_begin_of_new_word
raise NotImplementedError()
NotImplementedError
Hi @meiyiyeshi, thanks for your support.
It looks like you're using an unsupported model. Could you provide more details about the code you used to make the call?
microsoft
