Suggested prompting technique: using complex examples as in-context demonstrations

[FranxYao]

trafficstars

Hi,

I see there is a paper list about prompting. Would like to suggest the complexity-based prompting paper (https://arxiv.org/abs/2210.00720) where the basic idea is to use cases with more reasoning steps as in-context demonstrations. It has +8 accuracy on GSM8K and +18 accuracy on MathQA, along with multiple detailed prompting tricks.

Later this paper is recommended in Lilian's blog (https://lilianweng.github.io/posts/2023-03-15-prompt-engineering/) and adapted by Zheng et. al. (https://arxiv.org/abs/2304.09797) which achieves +8 accuracy on MATH and become the SOTA prompt for MATH.