direct-preference-optimization icon indicating copy to clipboard operation
direct-preference-optimization copied to clipboard

How are evals done on trained models?

Open lesnikow opened this issue 1 year ago • 0 comments

Thanks for putting this together. I am wondering how are evals done on trained models.

Are there some third-party evaluation libraries that you use to measure trained model performance/metric, or some other eval code available?

Thanks in advance.

lesnikow avatar May 22 '24 23:05 lesnikow