openai-tokens icon indicating copy to clipboard operation
openai-tokens copied to clipboard

Possible issue with `limit` and the dynamic wrapper

Open mrsteele opened this issue 2 years ago • 0 comments

If we set limit=1, wouldn't it just pick the largest model and still fail?

  1. User wants limit=5 and uses dynamic models for 3.5 and the 16k version
  2. Results -> it will fail on the first, and fail on the second most likely.

...ideally limit should just be removed from the dynamic response...

mrsteele avatar Aug 15 '23 21:08 mrsteele