[Question]: Can one-flow improve the inference speed of glm-large-chinese model?one-flow是否能提升glm-large-chinese模型的推理速度

[mechigonft]

Description

Can one-flow improve the inference speed of glm-large-chinese model?one-flow是否能提升glm-large-chinese模型的推理速度

Alternatives

Can one-flow improve the inference speed of glm-large-chinese model?one-flow是否能提升glm-large-chinese模型的推理速度

[jackalcooper]

check this out https://github.com/Oneflow-Inc/one-glm

[mechigonft]

Hello, thank you very much for your reply. I know about the project one-glm, but this project only accelerates the training phase, and there is no script for inference acceleration. What you mean is that the inference acceleration of the one-glm project still uses glm official script? 哈喽，你好，非常感谢你的回复，我知道这个项目one-glm，但是这个项目中只是训练阶段的加速，并没有推理加速的脚本，你指的是one-glm项目的推理加速仍然用glm官方的脚本吗？

[jackalcooper]

指的是如果感兴趣的话，可以参考这个仓库来实现推理的加速脚本，应该是可行的。如果有更定制化的需求，请将需求发送至 [email protected]

[mechigonft]

请问这个定制是否是收费的

[yuanms2]

请问这个定制是否是收费的

面向大模型的推理系统是商业产品，是需要收费的