王泽鹏

如果同时用到transformer和modelscope，会出现在~/.cache/huggingface中找不到模型的错误。

1

import torch import sys sys.path.append('./') from videollama2.conversation import conv_templates, SeparatorStyle from videollama2.constants import DEFAULT_MMODAL_TOKEN, MMODAL_TOKEN_INDEX from videollama2.mm_utils import get_model_name_from_path, tokenizer_MMODAL_token, KeywordsStoppingCriteria, process_video, process_image from videollama2.model.builder import load_pretrained_model from modelscope import...

Mismatch in shape When vae.enable_gradient_checkpointing()

3

### System Info / 系統信息 I decode latents by vae. And i enable gradient checkpoint in vae. When loss.backward(), I meet the error: Exception has occurred: RuntimeError Mismatch in shape:...