ySingularity
ySingularity
It seems to have the same architecture as [llava](https://huggingface.co/liuhaotian/llava-v1.5-7b), you can try to load it by setting MODEL_TYPE=llava?
It is not supported specially yet, we will have a try and find the problem. It would be appreciated if you could show us some error logs.
> yi-vl have little difference with lalva, We add LayNorm in the two-layer MLP of the projection module. Current implementation matches '^mlp(\d+)x_gelu$', and generates gelu and MLP. So that there...
可以配置一下FT_DEBUG_PRINT_LEVEL=DEBUG看看中间输出结果是否正常
We will fix it later. You can skip lfs download for now, as most of these files are used for testing.
could you please check where the compute type is set as uint32
It seems that some config is not loaded successfully, please check whether your ckpt config is legal.
We adapt qwen2 according to config in hf. Could you please check which config is not positive and its value?
w8a8还是weight only，weight only暂时还没支持
等我们下次更新补充这部分文档说明 直接转的ckpt格式可能会有点问题