openai-python icon indicating copy to clipboard operation
openai-python copied to clipboard

After fine tuning gpt3 model, how to know f1 score as a evaluation?

Open imrankh46 opened this issue 2 years ago • 1 comments

After fine tuning gpt3 for text generation, so how I can know f1 score using openai cli ?

imrankh46 avatar Dec 11 '22 09:12 imrankh46

Hi @imrankh46, thanks for writing in.

Calculating F1 score will depend a lot on your use case and given that it's very highly situation dependent, we don't support it in the CLI. That said, you might be able to find ideas either on help.openai.com or https://community.openai.com/. Hope this helps.

hallacy avatar Dec 11 '22 17:12 hallacy

I'm going to close this issue due to inactivity. Feel free to reopen

hallacy avatar Dec 20 '22 17:12 hallacy