unitxt
unitxt copied to clipboard
Update engine ibm_wml model
In prepare/engines/ibm_wml/llama3.py in model_list there is a model that is outdated and should be replaced with more recent meta-llama/llama-3-3-70b-instruct model. With this outdated model some fm-eval users might have problems with running benchmarks that requires llmaj metrics, like rag_benchmark.
PR to resolve this issue: https://github.com/IBM/unitxt/pull/1781
This issue is stale because it has been open for 30 days with no activity.
This issue was closed because it has been inactive for 14 days since being marked as stale.