yuanke

Results 139 comments of yuanke

can't install apex

conda install packaging not works, the bug still exist

Does transformerEngine support 2080ti?

I have 4 cards namely special version of 2080ti, each card have 22GB GPU memory the case come from https://swift.readthedocs.io/zh-cn/latest/Instruction/Megatron-SWIFT%E8%AE%AD%E7%BB%83.html Considering the log is huge, only paste the trackback ....

不是Issue，一点个人训练minimind的记录

能不能分享一下你的deepspeed的配置文件

[Feature Req]: Any plan on parallel training like deepseeed(zero3, offload nvme) and megatron(tensor parallem, layer pileline)?

+1

[Bug]: ImportError: /workspace/vllm-abo/vllm/_C.abi3.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKSsb

> cmake --build . --target _C which dir to run?

[Bug]: ImportError: /workspace/vllm-abo/vllm/_C.abi3.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKSsb

> > > cmake --build . --target _C > > > > > > which dir to run? > > Cmake from the same dir as when you build whole...

您好，请问该项目，您这边还会持续更新维护嘛

蛤蛤

How to add a VLLM deployed model in Page Assist, I tried to add it using OpenAI's apit but it doesn't work.如何在page assist 添加vllm部署的模型，我尝试使用openai的apit添加但无法使用。

+1

ValueError: Model architectures ['Qwen2ForCausalLM'] failed to be inspected. Please check the logs for more details.

conda create -n vllm python=3.10 conda activate vllm (vllm) amd00@mz00:~/repo/vllm$ pip install vllm==0.6.0 torch==2.4.0 triton==3.0.0 works on my machine.