Unsloth这个对cogvlm2-llama3-chinese-chat-19B 推理加速这个会实现吗？

[gehong-coder]

model, tokenizer = get_model_tokenizer(model_type, torch.float16,load_in_4bit=True,model_kwargs={'device_map': 'auto'},use_unsloth=True NotImplementedError: Unsloth: .cache/modelscope/hub/ZhipuAI/cogvlm2-llama3-chinese-chat-19B not supported yet!

[danielhanchen]

Wait is this a vision model?

[shimmyshimmer]

Hey @gehong-coder apologies for the delays. Vision models are now supported in Unsloth! Please update Unsloth :)

Read our blogpost: https://unsloth.ai/blog/vision Tweet: https://x.com/UnslothAI/status/1859667930075758793 GitHub post: https://github.com/unslothai/unsloth/releases/tag/November-2024 Vision Model uploads: https://huggingface.co/collections/unsloth/vision-multimodal-models-673eb9908fc2cb3deebd2fa3