big-brain icon indicating copy to clipboard operation
big-brain copied to clipboard

Evaluator with [0..1) range

Open agg23 opened this issue 2 years ago • 1 comments

What is the intended use of the provided Evaluators given the limited Score range of 0 to 1? Both exponential and sigmoid functions have very different utility in the domain of 0 to 1 vs the previous limit of 100. What is the intention behind clamping the Score values in the first place? I understand the desire to have the final output clamped for decision making, but I see no reason to clamp the intermediary values.

agg23 avatar Apr 04 '22 18:04 agg23

Originally, these were not clamped. After playing around with scorers and composition, though, I realized that a common problem that came up was that different Scorers would be hard to compose because they existed kind of in different score scales. And so the decision to be from 0 to 1 was to make all Scorers operate on "0% to 100%" as a scale, to make them easier to reason about during composition.

zkat avatar Apr 07 '22 21:04 zkat