StreamingT2V icon indicating copy to clipboard operation
StreamingT2V copied to clipboard

Regarding the error issue with "arch='ViT-H-14 ', version='laion2b_s32d_b79k"

Open ffhelly opened this issue 1 year ago • 2 comments

This is my code error. I have downloaded laion/CLIP-ViT-H-14-laion2B-s32B-b79K/ And it was placed under t2v_enhanced. But it seems that the path does not quite match this rule with the data.

Errors:

  • An error happened while trying to locate the file on the Hub and we cannot find the requested files in the local cache. Please check your connection and try again or make sure your Internet connection is on.
  • Expected a <class 'NoneType'> Given value type: <class 'jsonargparse.namespace.Namespace'> Given value: Namespace(class_path='t2v_enhanced.model.diffusers_conditional.models.controlnet.image_embedder.FrozenOpenCLIPImageEmbedder', init_args=Namespace(arch='ViT-H-14', version='laion2b_s32b_b79k', device='cuda', max_length=77, freeze=True, antialias=True, ucg_rate=0.0, unsqueeze_dim=False, repeat_to_max_len=False, num_image_crops=0, output_tokens=False))

ffhelly avatar May 08 '24 06:05 ffhelly

image_embedder.py line 75 code

def __init__(
    self,
    arch="ViT-H-14",
    version="laion2b_s32b_b79k",
    device="cuda",
    max_length=77,
    freeze=True,
    antialias=True,
    ucg_rate=0.0,
    unsqueeze_dim=False,
    repeat_to_max_len=False,
    num_image_crops=0,
    output_tokens=False,
):
    super().__init__()
    model, _, _ = open_clip.create_model_and_transforms(
        arch,
        device=torch.device("cpu"),
        pretrained=version,
    )
    del model.transformer
    self.model = model

ffhelly avatar May 08 '24 07:05 ffhelly

bro, I have the same problem, did you solve this problem?

YisuiTT avatar Jul 26 '24 01:07 YisuiTT