ircot icon indicating copy to clipboard operation
ircot copied to clipboard

How are prompts being picked up?

Open mohdsanadzakirizvi opened this issue 9 months ago • 5 comments

I am trying to experiment with prompts and I'm unable to check whether the system is picking up my changed prompts?

  1. I have overwritten the "prompt_file" for my experiment (found by checking out base_config for my experiment) in prompts/ folder.
  2. I am running IRCOT with flan-t5-base and have added "print" statements in llm_server/serve.py and commaqa/inference/ircot.py but I still don't see the prompts in the output.
  3. Are prompts dynamically read along with the dataset during run time?
  4. What should I change if I want to change prompt for a particular experiment?

mohdsanadzakirizvi avatar May 29 '24 14:05 mohdsanadzakirizvi