vikhyat
unknown model
Error occurred when executing MoondreamQuery:
Unknown model (vit_so400m_patch14_siglip_384)
File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\deforum-comfy-nodes\deforum_nodes\exec_hijack.py", line 59, in map_node_over_list return orig_exec(obj, input_data_all, func, allow_interrupt) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-moondream\nodes.py", line 62, in process self.moondream = Moondream.from_pretrained(checkpoint_path).to(device=device, dtype=dtype) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\python\lib\site-packages\transformers\modeling_utils.py", line 3594, in from_pretrained model = cls(config, *model_args, **model_kwargs) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-moondream\moondream\moondream.py", line 15, in init self.vision_encoder = VisionEncoder() File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\custom_nodes\ComfyUI-moondream\moondream\vision_encoder.py", line 98, in init VisualHolder(timm.create_model("vit_so400m_patch14_siglip_384")) File "D:\ComfyUI-aki\ComfyUI-aki-v1.2\python\lib\site-packages\timm\models\factory.py", line 67, in create_model raise RuntimeError('Unknown model (%s)' % model_name)
Related issue: https://github.com/vikhyat/moondream/issues/64
This is due to using an old version of timm from before when it added support for SigLIP. You can view the version of timm in your current environment by running pip show timm, and upgrade it by running pip install -U timm.
Leaving this issue open for now; I'm planning to remove the timm dependency so people stop running into this issue.
