agential icon indicating copy to clipboard operation
agential copied to clipboard

Published 20 hours ago • verified publisher icon agential-ai

[Feature Request]: Re-introduce Self-Refine

Open alckasoc opened this issue 8 months ago • 0 comments

Feature Description

There's an argument to be made that the mechanism of generating critique is somewhat agentic. Let's keep Self-Refine, but we will re-introduce it at least after https://github.com/agential-ai/agential/milestone/4

Implement:

  • [x] #206
  • [x] #208
  • [x] #209
  • [x] #207
  • [x] #210
  • [x] #211
  • [x] #212
  • [x] #213
  • [x] #214

Run:

  • [ ] HotpotQA
  • [ ] TriviaQA
  • [ ] AmbigNQ
  • [ ] GSM8k
  • [ ] SVAMP
  • [ ] TabMWP
  • [ ] MBPP
  • [ ] HumanEval
  • [ ] ALFWorld
  • [ ] WebShop
  • [ ] AgentBench (includes ALFWorld & WebShop)

alckasoc avatar Jun 25 '24 21:06 alckasoc