JiangDonglai98

It seems downgrade the transformers pacakge to 4.34.0 works. May be you can add it to the requirements.txt

It seems something wrong at here: xinference/model/llm/pytorch/utils.py line 124 if model.config.is_encoder_decoder: max_src_len = context_len else: max_src_len = context_len - max_new_tokens - 8 input_ids = input_ids[-max_src_len:] input_echo_len = len(input_ids) input_ids is...

Oh I find that the generate_config={"max_tokens": 4096} with "max_tokens" introduce that problem, but why in the example given by here shows we should add a max_tokens key as [input?](https://github.com/xorbitsai/inference/issues/404) ```...

OK, thanks a lot I will try your suggestion!

> > > 可以贴下创建路由的命令 > > > > > > 参照的https://www.secretflow.org.cn/zh-CN/docs/kuscia/v0.9.0b0/deployment/Docker_deployment_kuscia/deploy_p2p_cn#id7 相互颁发证书后在208执行scripts/deploy/add_domain.sh p207 p2p ；207执行scripts/deploy/add_domain.sh p208 p2p 之后在208执行scripts/deploy/join_to_host.sh p208 p207 [https://192.168.210.207:11080；207执行：scripts/deploy/join_to_host.sh](https://192.168.210.207:11080%EF%BC%9B207%E6%89%A7%E8%A1%8C%EF%BC%9Ascripts/deploy/join_to_host.sh) p207 p208 https://192.168.210.208:11080 > > 把其中的https换成http好像就可以了 您好，我目前MTLS按照https://www.secretflow.org.cn/zh-CN/docs/kuscia/v0.13.0b1/deployment/Docker_deployment_kuscia/deploy_p2p_cn给出docker 点对点的部署是成功的，但是在部署 notls...

> notls/tls/mtls 对于两个节点进行通信都需要相互颁发证书，获取对方的证书的。notls/tls/mtls 是针对本方内部提供的 kusciaapi 服务以及对外提供的通信服务的是 http 还是 https。 感谢您的回复！