sam-data-guy-iam

possible full import needed in unitxt.dataset

1

@matanor unitxt/src/unitxt/dataset.py currently has from .from .dataset_utils import get_dataset_artifact I just newly cloned both fm-eval and unitxt, and rebuilt the envs. For me, when I try running the basic run_text2text.py...

Increase n_resamples for GlobalMetric in testing so confidence intervals are not NaN

3

@eladven @matanor In test_utils/metrics.py/test_metric, for a GlobalMetric we have ```` if isinstance(metric, GlobalMetric) and metric.n_resamples: metric.n_resamples3 # Use a low number of resamples in testing for GlobalMetric, to save runtime...