dspy icon indicating copy to clipboard operation
dspy copied to clipboard

Published 20 hours ago • verified publisher icon stanfordnlp

BootstrapFewShotWithRandomSearch does not produce rationales for demos

Open adityalahiri opened this issue 11 months ago • 1 comments

I noticed that on using Cot with BootstrapFewShotWithRandomSearch, the selected or generated(?) demos in the prompt do not have reasoning, whereas the standard BootstrapFewShot has reasoning in all its demos inside the prompt. Is this intended? Having rationale for examples automatically is kind of sweet, and I hate to lose it when using the better bootstrapping procedure.

adityalahiri avatar Feb 27 '24 07:02 adityalahiri

Some will have and some may not! It depends on what performs best. Can you check again int the produced prompt?

okhat avatar Feb 27 '24 07:02 okhat

Basically the title is not correct in general, BootstrapFewShotWithRandomSearch does produce rationales for demos, but not sure what you saw in this specific case

okhat avatar Feb 28 '24 04:02 okhat