easy-llms icon indicating copy to clipboard operation
easy-llms copied to clipboard

Temperature

Open 7robots opened this issue 1 year ago • 1 comments

What is the maximum temperature value that easy-llms supports?

Although OpenAI documentation suggests that gpt-4o will support 0 to 2, I found that easy-llms errors out at 1.7 and above.

I was able to successfully query with a temperature up to 2 with a direct API request to OpenAI using chat completion.

7robots avatar Jun 28 '24 21:06 7robots

@7robots I seem to be able to call it with a temperature of 1.9 and 2:

% cat test.py 
from llms.openai import *

answer = gpt_4o(temperature=1.9).run("what llm are you?")
print(answer)


answer = gpt_4o(temperature=2).run("what llm are you?")
print(answer)

This is using the latest version:

% pip list | grep easy-llms
easy-llms                     0.1.7

Can you try a new/clean folder + creating a new venv with the latest version (if not using already)

ventz avatar Jun 28 '24 21:06 ventz