FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

The max_position_embedding is only 512 and 514 in config.py of "beg-rerangker-large" and "beg-large-zh-v1.5", which result the "max_input_token" cannot support over 512/514

Open xwqianbei opened this issue 1 year ago • 1 comments

The max_position_embedding is only 512 and 514 in config.py of "beg-rerangker-large" and "beg-large-zh-v1.5", which result the "max_input_token" cannot support over 512/514 image image so how can i solve the problem?

xwqianbei avatar May 11 '24 04:05 xwqianbei

If you want to process longer text, you can use new models: bge-m3 and bge-reranker-v2-m3, which both support 8192 tokens.

staoxiao avatar May 11 '24 09:05 staoxiao