collaborative-attention icon indicating copy to clipboard operation
collaborative-attention copied to clipboard

Published 20 hours ago • verified publisher icon epfml

No result

Open cuczy opened this issue 3 years ago • 1 comments

thank you but there have some question swap_to_collaborative(collab_model, BERTCollaborativeAdapter, dim_shared_query_key=128) I am also using the bert768 model. Is it here to change the size you want to compress? However, the result can only be output when it is set to 768. There is no way to output the result at 384 and 128. Why is this? 截屏2021-04-22下午3 37 07

cuczy avatar Apr 22 '21 07:04 cuczy

how to use bert？can you provide the BERTCollaborativeAttention code？

dns301 avatar Sep 14 '21 07:09 dns301