Chayenne
Chayenne
I rerun your process but get the right result of the retrieved dataset. 🤔 Would you please run this script to save your retrieved_dataset separately? ```python from prompt2model.prompt_parser import OpenAIInstructionParser,...
BTW, we are developing our colab demo. Maybe it would be easier to use.
https://colab.research.google.com/github/neulab/prompt2model/blob/add_colab_demo/colab_demo.ipynb Try this.
Which dataset? ` generated` or `retrieved`?
`DATASET_DICTS = [dataset_dict, retrieved_dataset_dict]` I am pretty familiar with `generated_dataset`, so I guess the problem lies in `retrieved_dataset_dict`. 🤔 Have you checked it?
Sure! I think it's not so complicated to do. But I will fix this after all the merges are done.
https://github.com/viswavi/prompt2model/issues/158 Also mentioned here.
@Eren Chenyang Zhao 赵晨阳 用on_epoch_end当然可以,但我当时我有几个疑惑 (1)如果我希望的eval_strategy是"steps"咋办? (2)这个东西怎么支持trainer自带的选best metrics,你只是做了evaluation把结果打出来了
And apart from this, my unit test for `SimpleDatasetGenerator` also makes the unit test slow. (And somehow costly)
@zhyncs Who is on the long context part?