openai-python icon indicating copy to clipboard operation
openai-python copied to clipboard

Storing metadata for fine-tuned models

Open eyaler opened this issue 3 years ago • 1 comments

I am fine tuning various models which have different styles of prompts. In inference I need to style the prompts adequately for each model. It would be great if it was possible to save a metadata or config json when creating the model, and retrieve it with the model. Otherwise I would need to either: (1) manage my own external database which is cumbersome when using google colab (2) hack the model suffix to encode my config params (let's not do that), or (3) reverse engineer my training jsonl to deduce the model's specific prompt styling, which is difficult. Any other options?

eyaler avatar Mar 30 '22 22:03 eyaler

That sounds like a reasonably summary of the situation to me. I'll pass this request on to the fine tuning team

hallacy avatar May 18 '22 21:05 hallacy

We don't plan to build out this feature, so closing the issue.

hallacy avatar Mar 07 '23 03:03 hallacy