unitxt

unitxt copied to clipboard

…rity)

welisheva22

In addition to fixing typos for the word "specialized" and changed "dedicated for" to "dedicated to" -- I also adjusted something that seemed to render differently than planned -- The...

welisheva22

Llm as judge ensemble

1

- The judge templates are defined at `prepare/templates/response_assessment/judges` - The judge artifacts as JSON files are available at `prepare/templates/response_assessment/judges/config_judges.json` and `prepare/templates/response_assessment/judges/ensemble_relevance_v1.json`. If it is possible to register these JSON objects...

pvn25

Signed-off-by: welisheva22

welisheva22

Add Scigen dataset for table2text task with llm_as_judge metric using llama3 as judge model This includes, * addition of scigen task card * addition of a llm_as_judge metric and prompt...

csrajmohan

welisheva22

Update CONTRIBUTING.md - update path name for activate

5

Looks like the bin directory may have been changed to Scripts -- the command seems to work when it's written as Scripts instead of bin

welisheva22

Signed-off-by: elronbandel

elronbandel

When using HFSystemFormat to define the format when loading a dataset an error is shown: ``` An error occurred while generating the dataset ``` HFSystemFormat function at the end applies...

allyssonf

Today, artifacts can be initialized with members of any type regarding of the definition. For example, the "card" attribute can be initialized by any type. Error checking is done sporadically...

yoavkatz