Yanbo Li

icon indicating a website link https://www.sustech.edu.cn/

icon company Southern University of Science and Technology icon location Shenzhen Guangdong, China icon location Majored in Electronic Science and Technology in Southern University of Science and Technology

Results 3 issues of Yanbo Li

For model generation，I fail with ERROR:KeyError: 'Cache only has 0 layers, attempted to access layer with index 0'

``` import copy from transformers import AutoModelForCausalLM, AutoTokenizer,AutoConfig from modify_llama import convert_kvcache_llama_heavy_recent import torch import time model_path = "/dataset/crosspipe/OriginModel/Llama-2-7b-chat-hf/" prompt_text = 'In a small, bustling cafe nestled in the heart...

coefficients setting？

thanks for your excellent job! So my question is how to set the appropriate coefficients according to different models? the coefficients in FLUX is [here](https://github.com/ali-vilab/TeaCache/blob/7c10efc4702c6b619f47805f7abe4a7a08085aa0/TeaCache4FLUX/teacache_flux.py#L113C17-L113C115), while the [coefficients](https://github.com/ali-vilab/TeaCache/blob/7c10efc4702c6b619f47805f7abe4a7a08085aa0/TeaCache4HunyuanVideo/teacache_sample_video.py#L102) in HunyuanVideo...

我想问一下4卡40GA100能跑WAN2.1-14B吗

4 comment