windreamer comments

Results 22 comments of


                                            windreamer

[DNM] PARACEL-51. Workaround solution for hostname issue with .local suffix under osx.

I do not have a Mac, but is this relevant? https://support.apple.com/en-us/HT201275

Running with Docker

`mesos` with `docker` is not an issue. but we need too many docker images: one for `paracel` as base image and one image for each application which is a sub-image...

[紧急!!!]训练 MoE 模型建议额外安装 GroupedGEMM失败

能不能看看您 nvcc 的版本？比如运行： ``` nvcc --version ``` 有点怀疑是 CUDA toolkit 版本问题

fix: make project PEP 517 compliant.

This PR is a direct followup of https://github.com/InternLM/lmdeploy/pull/3726

fix: fix package deprecation introduced by CUDA 13

> > In the `runtime_cuda.txt` file, the version of torch is restricted to `torch=2.0.0`. However, under CUDA 13, pytorch is required a minimum version of 2.9. We need to upgrade...

[Feature] turbomind后端是否会支持guided_decoding

> Any WIP guy. You can try PR #3965 and follow the progress there. Thanks.

[Feature] turbomind后端是否会支持guided_decoding

> > You can try PR [#3965](https://github.com/InternLM/lmdeploy/pull/3965) and follow the progress there. Thanks. > > Thank you for your work. Do you plan to implement response_format for the OpenAI API...

[Feature] turbomind后端是否会支持guided_decoding

> schema Can I have your test code？ I need some more info to debug. Thank you.