unitxt
unitxt copied to clipboard
🦄 Unitxt: a python library for getting data fired up and set for training and evaluation
Hi, We have a judgement metric that is not rating based but a descriptive one (we want the judge to describe the errors in the prediction). There is no existing...
Added a simple, dedicated README file with basic details and run instructions for the ToRR benchmark in Unitxt.
Requirement: support an `ibm_watsonx_ai.client.APIClient` with specially defined headers within an inference engine. Motivation: This is required for the use of such inference engines within `LLMaaJ` based metrics.
Still without success..