Quantus icon indicating copy to clipboard operation
Quantus copied to clipboard

New tutorial: on how to customise metrics with own user-defined functions

Open annahedstroem opened this issue 3 years ago • 2 comments

Would be great with a tutorial that shows:

  • how to employ user-defined explanation functions into the tests
  • how to customise the metric tests like perturb_func, similarity_func etc

Maybe call the tutorial something like: tutorial-customise-metrics-with-user-defined-functions

annahedstroem avatar Feb 25 '22 18:02 annahedstroem

Regarding similarity_func, I'm not sure to what extent the current API allows, but we could show how to compose a number of similarity_func's together. For example, in randomization tests, I have seen people used both cosine similarity and SSIM. So, with this composition, we could have results for both metrics with one experiment.

p16i avatar Mar 01 '22 14:03 p16i

@heytitle like the suggestion! would you be interested in contributing with a tutorial including that? :-) feel free to make a PR with it in that case!

annahedstroem avatar Mar 10 '22 16:03 annahedstroem