zhikaizhang
zhikaizhang
> We have submitted our method to NeurIPS 2023, and we are currently conducting more experiments based on EvaClip, hoping to achieve better results. Hi, @pandaupc Did you release the...
It is because of the slow convergence of the algorithm. The params K, maxIteration and threshold have an effect on that.
File "miniconda3/envs/otter_py39/lib/python3.9/site-packages/transformers/models/clip/modeling_clip.py", line 195, in forward patch_embeds = self.patch_embedding(pixel_values) # shape = [*, width, grid, grid] File ".local/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "miniconda3/envs/otter_py39/lib/python3.9/site-packages/accelerate/hooks.py", line 165, in...
should i downgrade the torch version from 2.0.0 to 1.x
> > File "miniconda3/envs/otter_py39/lib/python3.9/site-packages/transformers/models/clip/modeling_clip.py", line 195, in forward patch_embeds = self.patch_embedding(pixel_values) # shape = [*, width, grid, grid] File ".local/lib/python3.9/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl return forward_call(*args, **kwargs) File "miniconda3/envs/otter_py39/lib/python3.9/site-packages/accelerate/hooks.py", line...
> 内存不够的话可以增大交换空间 请问这个如何增大呢
1. Did you use a LLM model that is pretrained with Chinese data of large scale (and ensure the tokenizer is suitable for Chinese tokenization) ? 2. Did you use...
> > And about tune the first and last layer of the LLM, could you plz share more, I don't know how to adjust the code to make it run...
@JackeyHRan transformers 4.45.1 遇到了同样的问题，降级到4.40.0似乎可以正常保存权重