FrameworkBenchmarks
FrameworkBenchmarks copied to clipboard
Cached Queries UI incorrect?
Cached queries is run in sets of 1, 10, 20, 50, 100
With the value used being 100
However the UI suggests its 20 queries rather than 100
and that the sets are 1, 5, 10 ,15, 20 rather than 1, 10, 20, 50, 100
Indeed the cached query levels are run with the defaults:
parser.add_argument(
'--cached-query-levels',
nargs='+',
default=[1, 10, 20, 50, 100],
help='List of cached query levels to benchmark')
so it's just the UI that's incorrect. Nice find!