sglang icon indicating copy to clipboard operation
sglang copied to clipboard

offset = input_ids.index(self.config.image_token_index)

Open JAADARI opened this issue 1 year ago • 2 comments

anyone faced this problem before ? :

Exception in ModelRpcClient: Traceback (most recent call last): File "/home/fjaadari/anaconda3/envs/llava/lib/python3.10/site-packages/sglang/srt/managers/router/model_rpc.py", line 161, in exposed_step self.handle_generate_request(recv_req) File "/home/fjaadari/anaconda3/envs/llava/lib/python3.10/site-packages/sglang/srt/managers/router/model_rpc.py", line 243, in handle_generate_request req.input_ids, req.image_offset = self.model_runner.model.pad_input_ids( File "/home/fjaadari/anaconda3/envs/llava/lib/python3.10/site-packages/sglang/srt/models/llava.py", line 63, in pad_input_ids offset = input_ids.index(self.config.image_token_index) ValueError: 32000 is not in list

JAADARI avatar Feb 07 '24 16:02 JAADARI