unitxt icon indicating copy to clipboard operation
unitxt copied to clipboard

MetricPipeline in not limited in n_resamples in tests

Open yoavkatz opened this issue 1 year ago • 0 comments

This is the root cause: https://github.com/IBM/unitxt/blob/main/src/unitxt/test_utils/metrics.py#L75

I think we need to test if the inner metric in MetricPipeline is GlobalMetri object and if so, set the n_resamples=3 to it.

yoavkatz avatar Jan 03 '24 11:01 yoavkatz