Yue Zheng

icon company Chongqing University of Posts and Telecommunications icon location Chongqing icon location Major in Control Science and Engineering.

Results 4 issues of Yue Zheng

self.ln_pre or self.ln_post？

2 comment

https://github.com/sdc17/CrossGET/blob/dc3297534ecc2cbd7c0d3806df3e6426dc5c1a53/CLIP/clip/model.py#L296 https://github.com/sdc17/CrossGET/blob/dc3297534ecc2cbd7c0d3806df3e6426dc5c1a53/CLIP/clip/model.py#L297 https://github.com/sdc17/CrossGET/blob/dc3297534ecc2cbd7c0d3806df3e6426dc5c1a53/CLIP/clip/model.py#L298

How to perform an inference task?

Hello, when I want to perform an inference task, where is the entry function I need to execute? How do I create a model and upload a screenshot?

mat1 and mat2 shapes cannot be multiplied (576x1024 and 4096x1024)

2 comment

Hello, great work. I encountered a problem in the core code： ` File "/tmp/pycharm_project_858/m_llava/model/multimodal_projector/builder.py", line 112, in forward key = self.ln_k_1(self.k_proj_1(x_multi)).permute(1, 0, 2)` `RuntimeError: mat1 and mat2 shapes cannot be...

Where is BEATs_iter3_plus_AS2M.pt？

2 comment

Hello, how can i download the audio encoder in X-InstructBLIP project? The original download link seems to be broken.