camel icon indicating copy to clipboard operation
camel copied to clipboard

[Feature Request] Critic selection mechanism for models don't support multiple response at one time

Open Wendong-Fan opened this issue 5 months ago • 0 comments

Required prerequisites

  • [X] I have searched the Issue Tracker and Discussions that this hasn't already been reported. (+1 or comment there if it has.)
  • [ ] Consider asking first in a Discussion.

Motivation

raised by @coolbeevip https://github.com/orgs/camel-ai/discussions/985

In the Role-Playing critic scenario, the user agent receives multiple response options through the n parameter of the OpenAI API, from which the critic selects one to guide the assistant agent. (If my understanding is incorrect, please feel free to point it out!)

However, this mechanism only works well with the OpenAI API; a brief investigation shows that other models do not support the n parameter. Should we ensure consistency in this behavior when using non-OpenAI models through engineering methods? (For example, by looping n times and concatenating the results.)

Solution

No response

Alternatives

No response

Additional context

No response

Wendong-Fan avatar Sep 28 '24 13:09 Wendong-Fan