Easy-open-ai icon indicating copy to clipboard operation
Easy-open-ai copied to clipboard

Chat Completion Seed: Double instead of integer

Open Dustinhoefer opened this issue 11 months ago • 1 comments

The official API states:

seed integer or null Optional If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same seed and parameters should return the same result.

Determinism is not guaranteed, and you should refer to the system_fingerprint response parameter to monitor changes in the backend.

In your implementation you are using Double. Was this a change in the api or is this intentional?

Dustinhoefer avatar Mar 11 '24 18:03 Dustinhoefer

Using the seed the following error is also returned:

Unsuccessful response with HTTP status code 400 and error body: { "error": { "message": "1710180280865.0 is not of type 'integer' - 'seed'", "type": "invalid_request_error", "param": null, "code": null } }

In the ChatCompletionRequest it is a Double, in the CompletionRequest an Integer :D

Dustinhoefer avatar Mar 11 '24 18:03 Dustinhoefer