matanor

Results 5 comments of matanor

I think its ok, you can see in other files that this is how imports go within src/unitxt.

I think it would have been nice if we could have had params set on the recipie (meaning, passed between operators along the pipeline), and then they could be accessed...

Today we have a mechanism for disabling confidence interval calculation, by setting n_resamples to None. That mechanism is used as the implementation of a command line parameter in FM-Eval. There...

> for which metrics CI is disabled? and why? Is was disabled for the default version of rouge ([here](https://github.com/IBM/unitxt/blob/main/prepare/metrics/rouge.py#L5)). The reason is runtime. There are other cases of users that...

@sam-data-guy-iam i think we can increase, the disadvantage is only test runtime. Note that changing here would require updating the expected confidence intervals of other GlobalMetric derived objects. This can...