dunjinkai
dunjinkai
服务器端执行:python3 -m sglang.launch_server --model-path /data/MyModels/olmOCR-7B-0225-preview --chat-template qwen2-vl --log-level-http warning --host 192.168.1.100 客户端调用代码(windows): import openai from olmocr.prompts import build_finetuning_prompt from olmocr.prompts.anchor import get_anchor_text from olmocr.data.renderpdf import render_pdf_to_base64png client = openai.Client(base_url="http://192.168.1.100:30000/v1", api_key="EMPTY")...
我的也报这个错误,刚开始好好的,突然就报这个错了
CUDA_VISIBLE_DEVICES=2 python3 -m sglang.launch_server --model-path /data/pythons/py_dun/MyModels/olmOCR-7B-0225-preview --host 0.0.0.0 usage: launch_server.py [-h] [--host HOST] [--port PORT] [--device DEVICE] [--model-id MODEL_ID] launch_server.py: error: unrecognized arguments: --model-path /data/pythons/py_dun/MyModels/olmOCR-7B-0225-preview
> CUDA_VISIBLE_DEVICES=2 python3 -m sglang.launch_server --model-path /data/pythons/py_dun/MyModels/olmOCR-7B-0225-preview --host 0.0.0.0 usage: launch_server.py [-h] [--host HOST] [--port PORT] [--device DEVICE] [--model-id MODEL_ID] launch_server.py: error: unrecognized arguments: --model-path /data/pythons/py_dun/MyModels/olmOCR-7B-0225-preview 问题解决了,我自己创建了也给openai.py的文件,导致冲突,删了就没上述问题了,楼上也检查下,看是否创建了什么敏感名称的文件没有