openapi-test-data-generator icon indicating copy to clipboard operation
openapi-test-data-generator copied to clipboard

Published 20 hours ago • verified publisher icon tmizuma

Response Caching for OpenAI

Open tmizuma opened this issue 2 years ago • 0 comments

Is your feature request related to a problem? Please describe. Requesting responses from OpenAI can be time-consuming and expensive.

Describe the solution you'd like I would like to suggest implementing response caching for OpenAI to improve efficiency. This would involve storing previously requested responses and reusing them when the same request is made again, as long as the request parameters remain unchanged.

Describe alternatives you've considered One alternative solution could be to optimize the requests made to OpenAI, but this may not always be feasible or effective.

Additional context Add any other context or screenshots about the feature request here.

tmizuma avatar Mar 02 '23 18:03 tmizuma