Yazooliu
Yazooliu
> Which torch version do you use? And the CUDA version? show you the pip list detail info as following: Package Version ------------------------- ---------- accelerate 0.21.0 aiofiles 23.1.0 aiohttp 3.8.5...
> Which torch version do you use? And the CUDA version? Could I PR to fix this issue ? Thanks BestRegards Yazhou
PR is arise to fix this issue , please review and verify
No response ? for my PR?
> @erikreed I got it working with the base (not chat) model. The evaluation scripts serve as good examples. E.g.: > > ```python > from transformers import AutoModelForCausalLM, AutoTokenizer >...
Any respond?Could I try?
please check and approve.
seems nobody maintenance for this ? @CLAassistant @ @nomagick @ZeyuChen @llxxxll please correct me if i mentioned the wrong person. thanks.
> ### Description > Trying to get pipelines going with routes, documentation and samples are slightly off. Imports to Routes and Route are not correct and sample code will fail...
I installed trl-0.14.0 to fix . previse version is 0.15.0.dev0 And my other key package and version is: unsloth 2025.2.4 unsloth_zoo 2025.2.3 torch 2.5.1 torchaudio 2.5.1 torchvision 0.20.1 vllm 0.7.2...