FlagEmbedding
FlagEmbedding copied to clipboard
cpu部署
model = FlagModel(fmodel_path,
query_instruction_for_retrieval="为这个句子生成表示以用于检索相关文章:",
use_fp16=True) # Setting use_fp16 to True speeds up computation with a slight performance degradation
怎么把模型移到cpu上呢? use_fp16=True 或者False都会使用GPU
开头加上:
import os
os.environ["CUDA_VISIBLE_DEVICES"]=""