icu4x icon indicating copy to clipboard operation
icu4x copied to clipboard

Improve collator strength benchmarking

Open hsivonen opened this issue 8 months ago • 0 comments

Currently, the collator benchmarks separately run through all the strengths, but this makes the suite run for a long time without giving us information beyond the primary level, because the workloads have content that gets decided on the primary level.

We should

  1. Change the current workloads to run only with a single strength (it shoudn't matter in practice which strength could be primary to emphasize that the workloads are only exercising that strength anyway or tertiary to use the default configuration).
  2. Introduce new tests that are realistic scenarios that end up with at least some comparisons being decided by the higher strengths being benchmarked.

hsivonen avatar Apr 30 '25 07:04 hsivonen