CogVideo
CogVideo copied to clipboard
Finetune stuck at vae encode
System Info / 系統信息
11.8 pytorch 2.5.0
Information / 问题信息
- [ ] The official example scripts / 官方的示例脚本
- [ ] My own modified scripts / 我自己修改的脚本和任务
Reproduction / 复现过程
def encode_video(video):
video = video.to(accelerator.device, dtype=vae.dtype).unsqueeze(0)
video = video.permute(0, 2, 1, 3, 4) # [B, C, F, H, W]
latent_dist = vae.encode(video).latent_dist
return latent_dist
train_dataset.instance_videos = [encode_video(video) for video in train_dataset.instance_videos]
this fuction stuck https://github.com/THUDM/CogVideo/blob/main/finetune/train_cogvideox_lora.py
Expected behavior / 期待表现
workr normal