633WHU

truthfulqa_mc2 is Nan, while truthfulqa_mc1 is 1.00

5

I have finetued a model based on llama-2-hf, and run the evaluation with code and get truthfulqa_mc2 is Nan, while truthfulqa_mc1 is 1.00. What does that means? `python main.py --model...

The fixed value for feel_zeroes in get_binned_data may lead to deviation in some case.

9

In the implemntation of get_binned_data https://github.com/evidentlyai/evidently/blob/4e4637d361d11354d26f361a07e1c5a847bbfc74/src/evidently/calculations/stattests/utils.py#L33 By default, 0.0001 is used to fill the value with a percent of 0. It is valid when the minimum percent of non-zero is...

Fix 307 Temporary Redirect when use streamable_http

11

The default mount path of Streamable HTTP is /mcp, but in some environments, a 307 Temporary Redirect to /mcp/mcp/ will appear, causing the request to hang or fail. When the...