MOSS issues

关于微调一点不懂的问题

1

所以sft_data里面的东西应该长什么样的，文件结构是什么，里面的格式又是什么，然后微调完怎么应用，怎么验证微调成果？

OS: ubuntu GPU: v100 ERROR: Exception in ASGI application Traceback (most recent call last): File "/opt/conda/envs/py38/lib/python3.8/site-packages/uvicorn/protocols/websockets/websockets_impl.py", line 254, in run_asgi result = await self.app(self.scope, self.asgi_receive, self.asgi_send) File "/opt/conda/envs/py38/lib/python3.8/site-packages/uvicorn/middleware/proxy_headers.py", line 78,...

davefork

求更新进群码！

4

Rane2021

执行python moss_cli_demo.py报错

ConnectionResetError: [Errno 104] Connection reset by peer During handling of the above exception, another exception occurred: ProtocolError: ('Connection aborted.', ConnectionResetError(104, 'Connection reset by peer')) During handling of the above exception,...

yimai-gao

账号体验申请进度太慢了

chatGLM几分钟就通过了，moss等了2天都没有响应

yanniszhou

微调对硬件有什么要求？

2

对GPU有什么要求，8张3090的可以进行微调？

zhonglin516

推理显存沾满了后，看到显存自动释放了，且推理还在继续，是怎么做到

推理显存沾满了后，通过nvidia-smi，看到显存自动释放了，且推理还在继续，就解决了不会因为问题的变多，显存沾满，程序崩了，想问下，moss是怎么处理的，具体怎么做的，有清楚的吗，谢谢

guiniao

使用 moss-moon-003-sft-plugin-int8 加载模型提示如下错误，接口返回的乱码

使用 moss-moon-003-sft-plugin-int8 加载模型提示如下错误，接口返回的乱码 ```log root@c8534e683229:/home/MOSS-main# python moss-api.py Some weights of MossForCausalLM were not initialized from the model checkpoint at ./moss-moon-003-sft-plugin-int8 and are newly initialized because the shapes did not match:...

EtachGu