FlagEmbedding icon indicating copy to clipboard operation
FlagEmbedding copied to clipboard

When fine-tuning and using `query_instruction_for_retrieval` should document instruction be blank?

Open austinmw opened this issue 1 year ago • 1 comments

If I followed the fine-tuning instructions and added a query_instruction_for_retrieval, should I use the same, different, or blank ("") instruction for the document ingestion part?

austinmw avatar Jan 05 '24 17:01 austinmw

The query_instruction_for_retrieval will be added to query during fine-tuning. If you set this hyper-parameter, you should add it to query during inferencing. There is no need to add this instruction to document.

staoxiao avatar Jan 06 '24 12:01 staoxiao