littleevil

提问它是不是baichuan-13B，回答却是baichuan-7B，请问是为啥？

3

1 下载模型 ```python from huggingface_hub import snapshot_download snapshot_download(repo_id="baichuan-inc/Baichuan-13B-Chat", cache_dir=".") ``` 2 推理模型 ```python from fastapi import FastAPI, Request from transformers import AutoTokenizer, AutoModelForCausalLM, AutoConfig from transformers.generation.utils import GenerationConfig import uvicorn,...

[BUG] vllm推理qwen-72b-chat返回异常

7

### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this? - [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions ### 该问题是否在FAQ中有解答？ | Is there an...

bug: Error while serializing: IoError(Os { code: 28, kind: StorageFull, message: "No space left on device" })

2

### Describe the bug Error while serializing: IoError(Os { code: 28, kind: StorageFull, message: "No space left on device" }) ### To reproduce run ``` openllm start ./models--01-ai--Yi-34B-Chat/snapshots/a99ec35331cbfc9da596af7d4538fe2efecff03c --adapter-id ./yi-34b-chat/rank-0:default...

关于flask-todo-demo当前用户的问题

1

在app.py 61-63行取出当前用户 leancloud.User.get_current()取不出登录的用户信息，线程发生了改变。。。无法取出

不考虑加上RAT么？

1

https://arxiv.org/abs/2403.05313