unitxt icon indicating copy to clipboard operation
unitxt copied to clipboard

Update engine ibm_wml model

Open MikolajCharchut opened this issue 7 months ago • 1 comments

In prepare/engines/ibm_wml/llama3.py in model_list there is a model that is outdated and should be replaced with more recent meta-llama/llama-3-3-70b-instruct model. With this outdated model some fm-eval users might have problems with running benchmarks that requires llmaj metrics, like rag_benchmark.

MikolajCharchut avatar May 07 '25 15:05 MikolajCharchut

PR to resolve this issue: https://github.com/IBM/unitxt/pull/1781

MikolajCharchut avatar May 08 '25 13:05 MikolajCharchut

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] avatar Jun 08 '25 03:06 github-actions[bot]

This issue was closed because it has been inactive for 14 days since being marked as stale.

github-actions[bot] avatar Jun 22 '25 03:06 github-actions[bot]