FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

cpu部署

Open wanzhixiao opened this issue 1 year ago • 1 comments

model = FlagModel(fmodel_path, 
                  query_instruction_for_retrieval="为这个句子生成表示以用于检索相关文章:",
                  use_fp16=True) # Setting use_fp16 to True speeds up computation with a slight performance degradation

怎么把模型移到cpu上呢? use_fp16=True 或者False都会使用GPU

wanzhixiao avatar Mar 14 '24 10:03 wanzhixiao

开头加上:

import os
os.environ["CUDA_VISIBLE_DEVICES"]=""

staoxiao avatar Mar 15 '24 03:03 staoxiao