JittorLLMs

JittorLLMs copied to clipboard

shz1314

此方法可以加速推理速度吗

1

此方法可以加速推理速度吗

ZTurboX

是否支持微调后的模型

3

现在的版本能支持在自己的数据集上用ptuning或者lora之类的方法微调后的ChatGLM吗？

crellian

``` PS D:\ChatGLM\JittorLLMs> python cli_demo.py chatglm [i 0509 20:23:27.247000 80 compiler.py:955] Jittor(1.3.7.15) src: c:\users\yang\appdata\roaming\python\python310\site-packages\jittor [i 0509 20:23:27.408000 80 compiler.py:956] cl at C:\Users\yang\.cache\jittor\msvc\VC\_\_\_\_\_\bin\cl.exe(19.29.30133) [i 0509 20:23:27.408000 80 compiler.py:957] cache_path: C:\Users\yang\.cache\jittor\jt1.3.7\cl\py3.10.11\Windows-10-10.x08\11thGenIntelRCxaa\default [i...

The-Eleven11

支持在树莓派3B上运行吗？

2

支持在树莓派3B上运行吗？

SFidea

Fix typo

1

`ChatGLMMdoel` -> `ChatGLMModel`

zxytim

[w 0508 22:52:21.339000 08 log.h:194] Load cpu_mem_limit from env( "-1" ) failed, use default -1 [i 0508 22:52:21.339000 08 swap.cc:29] Load cpu_mem_limit: -1 [w 0508 22:52:21.339000 08 log.h:194] Load device_mem_limit...

hellobinker

无法使用 `torch.cuda.empty_cache()`来清理缓存，使用的`site-packages/jtorch/cuda.py`中没有清理显存相关的操作。 ``` # cuda.py import jittor as jt import jtorch def is_available(): return jt.has_cuda def device_count(): return int(jt.has_cuda) def set_device(device=None): pass def get_rng_state(device=None): pass def current_device(): return jtorch.device("cuda") class...

YingchaoX

如题，接下来是完整的错误信息（项目文件夹为 H:\JittorLLMs-main） ```bash H:\JittorLLMs-main>python web_demo.py chatglm ``` ```python [i 0508 19:55:32.337907 24 compiler.py:955] Jittor(1.3.7.15) src: c:\users\playmcblock\appdata\local\packages\pythonsoftwarefoundation.python.3.9_qbz5n2kfra8p0\localcache\local-packages\python39\site-packages\jittor [i 0508 19:55:32.458067 24 compiler.py:956] cl at C:\Users\PlayMcBlock\.cache\jittor\msvc\VC\_\_\_\_\_\bin\cl.exe(19.29.30133) [i 0508 19:55:32.459065 24 compiler.py:957] cache_path:...

PlayMcBKuwu

ERROR:'import jittor as jt' 启动报错

2

环境：centos7.6 gcc5.5 python3.9.6 venv环境： Package Version ------------------------ ---------- astunparse 1.6.3 certifi 2022.12.7 charset-normalizer 3.1.0 cmake 3.26.1 filelock 3.11.0 idna 3.4 Jinja2 3.1.2 jittor 1.3.7.13 jtorch 0.1.3 lit 16.0.0 MarkupSafe 2.1.2...

wangtaihong