Yuxuan Zhang

Can it is running on Mac using with torch like to.("mps")

I know, but I have no way to verify it, because I don't have a high-performance Mac that can load this model, therefore, we need support from the community to...

请按照issue置顶的方案解决

These are two different models, both of which are trained from scratch. The model structures are somewhat dissimilar, especially in the embedding part. The other differences are mainly in the...

想确定你是否开启了BF16推理，另外，能复现上述错误吗，我们更好定位

HF已经写了，不支持分布式，暂时没办法解决

现在可以多GPU推理了，尝试按照最新的cli demo执行

Our prompt optimization is implemented in convert_demo.py, not in cli_demo.py. You can refer to our Gradio demo for guidance on how to operate it. and for VBench yes the optimization...

yes