wasmtime
wasmtime copied to clipboard
bytecodealliance
Update format of benchmark results
Shows pct_change on x64 for the patch if merged compared to current head for main.
Hi .. Pct_change is based on clocktick event cycles where the benchmarks are run with Sightglass. A negative pct_change means clockticks are expected to be reduced for the benchmark, for that phase, and by that factor, if the patch were merged (i.e. negative is good).
| wasm | arch | phase | pct_change |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Compilation | -0.050192 |
| benchmarks/blake3-scalar | x86_64 | Execution | -0.077807 |
| benchmarks/blake3-scalar | x86_64 | Instantiation | -0.010935 |
| benchmarks/blake3-simd | x86_64 | Compilation | -0.015642 |
| benchmarks/blake3-simd | x86_64 | Execution | -0.013008 |
| benchmarks/blake3-simd | x86_64 | Instantiation | -0.112058 |
| benchmarks/bz2 | x86_64 | Compilation | 0.047539 |
| benchmarks/bz2 | x86_64 | Execution | 0.017599 |
| benchmarks/bz2 | x86_64 | Instantiation | 0.031295 |
| benchmarks/intgemm-simd | x86_64 | Compilation | 0.000530 |
| benchmarks/intgemm-simd | x86_64 | Execution | 0.001857 |
| benchmarks/intgemm-simd | x86_64 | Instantiation | -0.001350 |
| benchmarks/meshoptimizer | x86_64 | Compilation | -0.015015 |
| benchmarks/meshoptimizer | x86_64 | Execution | -0.000462 |
| benchmarks/meshoptimizer | x86_64 | Instantiation | -0.026642 |
| benchmarks/noop | x86_64 | Compilation | 0.016306 |
| benchmarks/noop | x86_64 | Execution | 0.560142 |
| benchmarks/noop | x86_64 | Instantiation | 0.077786 |
| benchmarks/pulldown-cmark | x86_64 | Compilation | -0.018827 |
| benchmarks/pulldown-cmark | x86_64 | Execution | -0.032975 |
| benchmarks/pulldown-cmark | x86_64 | Instantiation | -0.061880 |
| benchmarks/shootout-ackermann | x86_64 | Compilation | -0.015801 |
| benchmarks/shootout-ackermann | x86_64 | Execution | 0.253876 |
| benchmarks/shootout-ackermann | x86_64 | Instantiation | 0.029229 |
| benchmarks/shootout-base64 | x86_64 | Compilation | 0.072468 |
| benchmarks/shootout-base64 | x86_64 | Execution | 0.000160 |
| benchmarks/shootout-base64 | x86_64 | Instantiation | -0.028566 |
| benchmarks/shootout-ctype | x86_64 | Compilation | 0.011471 |
| benchmarks/shootout-ctype | x86_64 | Execution | -0.000079 |
| benchmarks/shootout-ctype | x86_64 | Instantiation | 0.007039 |
| benchmarks/shootout-ed25519 | x86_64 | Compilation | 0.014212 |
| benchmarks/shootout-ed25519 | x86_64 | Execution | -0.000338 |
| benchmarks/shootout-ed25519 | x86_64 | Instantiation | 0.045068 |
| benchmarks/shootout-fib2 | x86_64 | Compilation | -0.019863 |
| benchmarks/shootout-fib2 | x86_64 | Execution | 0.000087 |
| benchmarks/shootout-fib2 | x86_64 | Instantiation | 0.033255 |
| benchmarks/shootout-gimli | x86_64 | Compilation | 0.031095 |
| benchmarks/shootout-gimli | x86_64 | Execution | 0.012047 |
| benchmarks/shootout-gimli | x86_64 | Instantiation | 0.143404 |
| benchmarks/shootout-heapsort | x86_64 | Compilation | 0.016651 |
| benchmarks/shootout-heapsort | x86_64 | Execution | -0.000087 |
| benchmarks/shootout-heapsort | x86_64 | Instantiation | -0.158032 |
| benchmarks/shootout-keccak | x86_64 | Compilation | -0.000802 |
| benchmarks/shootout-keccak | x86_64 | Execution | 0.001600 |
| benchmarks/shootout-keccak | x86_64 | Instantiation | -0.029113 |
| benchmarks/shootout-matrix | x86_64 | Compilation | -0.036196 |
| benchmarks/shootout-matrix | x86_64 | Execution | 0.000788 |
| benchmarks/shootout-matrix | x86_64 | Instantiation | 0.007406 |
| benchmarks/shootout-memmove | x86_64 | Compilation | -0.138983 |
| benchmarks/shootout-memmove | x86_64 | Execution | 0.000900 |
| benchmarks/shootout-memmove | x86_64 | Instantiation | -0.041495 |
| benchmarks/shootout-minicsv | x86_64 | Compilation | -0.046978 |
| benchmarks/shootout-minicsv | x86_64 | Execution | 0.000761 |
| benchmarks/shootout-minicsv | x86_64 | Instantiation | 0.039889 |
| benchmarks/shootout-nestedloop | x86_64 | Compilation | 0.011639 |
| benchmarks/shootout-nestedloop | x86_64 | Execution | -0.003988 |
| benchmarks/shootout-nestedloop | x86_64 | Instantiation | 0.015794 |
| benchmarks/shootout-random | x86_64 | Compilation | 0.027558 |
| benchmarks/shootout-random | x86_64 | Execution | 0.000611 |
| benchmarks/shootout-random | x86_64 | Instantiation | -0.040762 |
| benchmarks/shootout-ratelimit | x86_64 | Compilation | -0.009918 |
| benchmarks/shootout-ratelimit | x86_64 | Execution | 0.023033 |
| benchmarks/shootout-ratelimit | x86_64 | Instantiation | 0.086613 |
| benchmarks/shootout-seqhash | x86_64 | Compilation | -0.110301 |
| benchmarks/shootout-seqhash | x86_64 | Execution | -0.000080 |
| benchmarks/shootout-seqhash | x86_64 | Instantiation | 0.039469 |
| benchmarks/shootout-sieve | x86_64 | Compilation | 0.039958 |
| benchmarks/shootout-sieve | x86_64 | Execution | 0.001072 |
| benchmarks/shootout-sieve | x86_64 | Instantiation | 0.017271 |
| benchmarks/shootout-switch | x86_64 | Compilation | 0.034087 |
| benchmarks/shootout-switch | x86_64 | Execution | 0.000888 |
| benchmarks/shootout-switch | x86_64 | Instantiation | 0.011962 |
| benchmarks/shootout-xblabla20 | x86_64 | Compilation | -0.006581 |
| benchmarks/shootout-xblabla20 | x86_64 | Execution | 0.020334 |
| benchmarks/shootout-xblabla20 | x86_64 | Instantiation | -0.056945 |
| benchmarks/shootout-xchacha20 | x86_64 | Compilation | -0.039488 |
| benchmarks/shootout-xchacha20 | x86_64 | Execution | -0.000684 |
| benchmarks/shootout-xchacha20 | x86_64 | Instantiation | -0.090442 |
| benchmarks/spidermonkey | x86_64 | Compilation | 0.006616 |
| benchmarks/spidermonkey | x86_64 | Execution | -0.005827 |
| benchmarks/spidermonkey | x86_64 | Instantiation | -0.020950 |
Shows pct_change on x64 for the patch if merged compared to current head for main.
Hi .. Pct_change is based on clocktick event cycles where the benchmarks are run with Sightglass. A negative pct_change means clockticks are expected to be reduced for the benchmark, for that phase, and by that factor, if the patch were merged (i.e. negative is good).
| wasm | arch | phase | pct_change |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Compilation | -0.016673 |
| benchmarks/blake3-scalar | x86_64 | Execution | 0.015206 |
| benchmarks/blake3-scalar | x86_64 | Instantiation | 0.042582 |
| benchmarks/blake3-simd | x86_64 | Compilation | -0.103264 |
| benchmarks/blake3-simd | x86_64 | Execution | -0.013309 |
| benchmarks/blake3-simd | x86_64 | Instantiation | -0.047856 |
| benchmarks/bz2 | x86_64 | Compilation | -0.065630 |
| benchmarks/bz2 | x86_64 | Execution | -0.038392 |
| benchmarks/bz2 | x86_64 | Instantiation | 0.104766 |
| benchmarks/intgemm-simd | x86_64 | Compilation | 0.004482 |
| benchmarks/intgemm-simd | x86_64 | Execution | -0.000084 |
| benchmarks/intgemm-simd | x86_64 | Instantiation | 0.009399 |
| benchmarks/meshoptimizer | x86_64 | Compilation | 0.011008 |
| benchmarks/meshoptimizer | x86_64 | Execution | -0.003755 |
| benchmarks/meshoptimizer | x86_64 | Instantiation | 0.074026 |
| benchmarks/noop | x86_64 | Compilation | -0.023854 |
| benchmarks/noop | x86_64 | Execution | -0.223529 |
| benchmarks/noop | x86_64 | Instantiation | -0.037909 |
| benchmarks/pulldown-cmark | x86_64 | Compilation | -0.016603 |
| benchmarks/pulldown-cmark | x86_64 | Execution | -0.007214 |
| benchmarks/pulldown-cmark | x86_64 | Instantiation | -0.005431 |
| benchmarks/shootout-ackermann | x86_64 | Compilation | -0.047876 |
| benchmarks/shootout-ackermann | x86_64 | Execution | 0.013962 |
| benchmarks/shootout-ackermann | x86_64 | Instantiation | 0.034680 |
| benchmarks/shootout-base64 | x86_64 | Compilation | -0.023650 |
| benchmarks/shootout-base64 | x86_64 | Execution | 0.001237 |
| benchmarks/shootout-base64 | x86_64 | Instantiation | 0.052683 |
| benchmarks/shootout-ctype | x86_64 | Compilation | 0.026490 |
| benchmarks/shootout-ctype | x86_64 | Execution | 0.000262 |
| benchmarks/shootout-ctype | x86_64 | Instantiation | 0.016364 |
| benchmarks/shootout-ed25519 | x86_64 | Compilation | 0.030841 |
| benchmarks/shootout-ed25519 | x86_64 | Execution | -0.003552 |
| benchmarks/shootout-ed25519 | x86_64 | Instantiation | 0.059243 |
| benchmarks/shootout-fib2 | x86_64 | Compilation | -0.024481 |
| benchmarks/shootout-fib2 | x86_64 | Execution | -0.000072 |
| benchmarks/shootout-fib2 | x86_64 | Instantiation | -0.008940 |
| benchmarks/shootout-gimli | x86_64 | Compilation | 0.019612 |
| benchmarks/shootout-gimli | x86_64 | Execution | -0.001584 |
| benchmarks/shootout-gimli | x86_64 | Instantiation | 0.082201 |
| benchmarks/shootout-heapsort | x86_64 | Compilation | -0.009361 |
| benchmarks/shootout-heapsort | x86_64 | Execution | -0.001727 |
| benchmarks/shootout-heapsort | x86_64 | Instantiation | -0.000774 |
| benchmarks/shootout-keccak | x86_64 | Compilation | -0.000508 |
| benchmarks/shootout-keccak | x86_64 | Execution | 0.006049 |
| benchmarks/shootout-keccak | x86_64 | Instantiation | 0.076634 |
| benchmarks/shootout-matrix | x86_64 | Compilation | 0.089116 |
| benchmarks/shootout-matrix | x86_64 | Execution | -0.000565 |
| benchmarks/shootout-matrix | x86_64 | Instantiation | 0.035916 |
| benchmarks/shootout-memmove | x86_64 | Compilation | -0.128039 |
| benchmarks/shootout-memmove | x86_64 | Execution | -0.002948 |
| benchmarks/shootout-memmove | x86_64 | Instantiation | -0.076299 |
| benchmarks/shootout-minicsv | x86_64 | Compilation | 0.062446 |
| benchmarks/shootout-minicsv | x86_64 | Execution | -0.000011 |
| benchmarks/shootout-minicsv | x86_64 | Instantiation | 0.032456 |
| benchmarks/shootout-nestedloop | x86_64 | Compilation | 0.018903 |
| benchmarks/shootout-nestedloop | x86_64 | Execution | 0.003843 |
| benchmarks/shootout-nestedloop | x86_64 | Instantiation | 0.050515 |
| benchmarks/shootout-random | x86_64 | Compilation | 0.024180 |
| benchmarks/shootout-random | x86_64 | Execution | 0.000165 |
| benchmarks/shootout-random | x86_64 | Instantiation | -0.043014 |
| benchmarks/shootout-ratelimit | x86_64 | Compilation | 0.031334 |
| benchmarks/shootout-ratelimit | x86_64 | Execution | 0.000159 |
| benchmarks/shootout-ratelimit | x86_64 | Instantiation | -0.081111 |
| benchmarks/shootout-seqhash | x86_64 | Compilation | 0.045201 |
| benchmarks/shootout-seqhash | x86_64 | Execution | -0.000857 |
| benchmarks/shootout-seqhash | x86_64 | Instantiation | -0.041038 |
| benchmarks/shootout-sieve | x86_64 | Compilation | 0.019440 |
| benchmarks/shootout-sieve | x86_64 | Execution | 0.001493 |
| benchmarks/shootout-sieve | x86_64 | Instantiation | 0.045501 |
| benchmarks/shootout-switch | x86_64 | Compilation | -0.091198 |
| benchmarks/shootout-switch | x86_64 | Execution | -0.001740 |
| benchmarks/shootout-switch | x86_64 | Instantiation | 0.051443 |
| benchmarks/shootout-xblabla20 | x86_64 | Compilation | -0.049690 |
| benchmarks/shootout-xblabla20 | x86_64 | Execution | 0.014771 |
| benchmarks/shootout-xblabla20 | x86_64 | Instantiation | 0.079765 |
| benchmarks/shootout-xchacha20 | x86_64 | Compilation | -0.064121 |
| benchmarks/shootout-xchacha20 | x86_64 | Execution | -0.030658 |
| benchmarks/shootout-xchacha20 | x86_64 | Instantiation | 0.369637 |
| benchmarks/spidermonkey | x86_64 | Compilation | 0.013221 |
| benchmarks/spidermonkey | x86_64 | Execution | 0.000563 |
| benchmarks/spidermonkey | x86_64 | Instantiation | 0.010729 |
Change factor shows patch effect on x64 if merged compared to current head for main.
Results are based on clocktick event cycles. A negative change factor means clockticks are expected to be reduced.
wasm,arch,phase,change_factor benchmarks/blake3-scalar,x86_64,Compilation,-0.018020484435345097 benchmarks/blake3-simd,x86_64,Compilation,0.07125329573991457 benchmarks/bz2,x86_64,Compilation,0.05663455448270427 benchmarks/intgemm-simd,x86_64,Compilation,-0.013531855296949113 benchmarks/meshoptimizer,x86_64,Compilation,-0.00971237906343736 benchmarks/noop,x86_64,Compilation,0.029134824870321596 benchmarks/pulldown-cmark,x86_64,Compilation,0.013228006570848327 benchmarks/shootout-ackermann,x86_64,Compilation,0.020002081773226932 benchmarks/shootout-base64,x86_64,Compilation,-0.007003736627465562 benchmarks/shootout-ctype,x86_64,Compilation,-0.004608752229133928 benchmarks/shootout-ed25519,x86_64,Compilation,-0.008277265715443072 benchmarks/shootout-fib2,x86_64,Compilation,0.011220106614727277 benchmarks/shootout-gimli,x86_64,Compilation,0.014832410864674905 benchmarks/shootout-heapsort,x86_64,Compilation,-0.017634457779194368 benchmarks/shootout-keccak,x86_64,Compilation,0.0008661978001676118 benchmarks/shootout-matrix,x86_64,Compilation,0.023007335358968373 benchmarks/shootout-memmove,x86_64,Compilation,0.06472674765091657 benchmarks/shootout-minicsv,x86_64,Compilation,0.04885790067539486 benchmarks/shootout-nestedloop,x86_64,Compilation,-0.005068418090198201 benchmarks/shootout-random,x86_64,Compilation,0.016706885835964025 benchmarks/shootout-ratelimit,x86_64,Compilation,0.07955751122453081 benchmarks/shootout-seqhash,x86_64,Compilation,-0.11467834513027975 benchmarks/shootout-sieve,x86_64,Compilation,-0.007751763857428817 benchmarks/shootout-switch,x86_64,Compilation,-0.009151471234979724 benchmarks/shootout-xblabla20,x86_64,Compilation,0.022487753788641207 benchmarks/shootout-xchacha20,x86_64,Compilation,-0.0009132185261474524 benchmarks/spidermonkey,x86_64,Compilation,-0.023810309986815992
wasm,arch,phase,change_factor benchmarks/blake3-scalar,x86_64,Instantiation,0.08154909323320281 benchmarks/blake3-simd,x86_64,Instantiation,-0.09435186486866431 benchmarks/bz2,x86_64,Instantiation,0.11957405581218317 benchmarks/intgemm-simd,x86_64,Instantiation,0.4747130822742083 benchmarks/meshoptimizer,x86_64,Instantiation,0.05548355858101073 benchmarks/noop,x86_64,Instantiation,0.17304086063955793 benchmarks/pulldown-cmark,x86_64,Instantiation,0.27660061848585493 benchmarks/shootout-ackermann,x86_64,Instantiation,-0.11412628925811696 benchmarks/shootout-base64,x86_64,Instantiation,0.10533374373406024 benchmarks/shootout-ctype,x86_64,Instantiation,-0.08610943958331274 benchmarks/shootout-ed25519,x86_64,Instantiation,0.011161434628267575 benchmarks/shootout-fib2,x86_64,Instantiation,0.02740152576677568 benchmarks/shootout-gimli,x86_64,Instantiation,0.05344418052256539 benchmarks/shootout-heapsort,x86_64,Instantiation,0.028390272819825535 benchmarks/shootout-keccak,x86_64,Instantiation,0.150034180758168 benchmarks/shootout-matrix,x86_64,Instantiation,-0.004677493388122622 benchmarks/shootout-memmove,x86_64,Instantiation,0.04072790294627393 benchmarks/shootout-minicsv,x86_64,Instantiation,0.10937690525545674 benchmarks/shootout-nestedloop,x86_64,Instantiation,0.019406581075283036 benchmarks/shootout-random,x86_64,Instantiation,-0.435801452421951 benchmarks/shootout-ratelimit,x86_64,Instantiation,0.027382681285544885 benchmarks/shootout-seqhash,x86_64,Instantiation,0.01843876843876835 benchmarks/shootout-sieve,x86_64,Instantiation,0.0858841589149062 benchmarks/shootout-switch,x86_64,Instantiation,-0.007686075517557511 benchmarks/shootout-xblabla20,x86_64,Instantiation,0.03505049314314901 benchmarks/shootout-xchacha20,x86_64,Instantiation,0.011538815365812027 benchmarks/spidermonkey,x86_64,Instantiation,0.029164479200131543
wasm,arch,phase,change_factor benchmarks/blake3-scalar,x86_64,Execution,0.02391215030067606 benchmarks/blake3-simd,x86_64,Execution,-0.02889447530509881 benchmarks/bz2,x86_64,Execution,0.0020508170840825013 benchmarks/intgemm-simd,x86_64,Execution,0.00045994772965185504 benchmarks/meshoptimizer,x86_64,Execution,-0.0010003236316716846 benchmarks/noop,x86_64,Execution,-0.3480209111277073 benchmarks/pulldown-cmark,x86_64,Execution,-0.00206622418118807 benchmarks/shootout-ackermann,x86_64,Execution,0.06372045220966083 benchmarks/shootout-base64,x86_64,Execution,0.0042822672464284395 benchmarks/shootout-ctype,x86_64,Execution,0.0018272451989089777 benchmarks/shootout-ed25519,x86_64,Execution,-0.0013595588275698844 benchmarks/shootout-fib2,x86_64,Execution,0.001143417208171682 benchmarks/shootout-gimli,x86_64,Execution,0.005878084269548056 benchmarks/shootout-heapsort,x86_64,Execution,0.001104436110415108 benchmarks/shootout-keccak,x86_64,Execution,-0.009104548361943854 benchmarks/shootout-matrix,x86_64,Execution,0.0008669202313014157 benchmarks/shootout-memmove,x86_64,Execution,0.00207352742992839 benchmarks/shootout-minicsv,x86_64,Execution,0.002640286519395074 benchmarks/shootout-nestedloop,x86_64,Execution,-0.002400709949495039 benchmarks/shootout-random,x86_64,Execution,3.1917472615550224e-05 benchmarks/shootout-ratelimit,x86_64,Execution,0.0007861819136574244 benchmarks/shootout-seqhash,x86_64,Execution,0.0024118983474439304 benchmarks/shootout-sieve,x86_64,Execution,0.0018030860493345457 benchmarks/shootout-switch,x86_64,Execution,-0.00013305292489473874 benchmarks/shootout-xblabla20,x86_64,Execution,-0.0007567545061339942 benchmarks/shootout-xchacha20,x86_64,Execution,-0.012226764288853276 benchmarks/spidermonkey,x86_64,Execution,-0.0003628088639525684
phase,change_factor Compilation,0.008605672417710477 Execution,-0.010790129505455161 Instantiation,0.04410906584604744
Change factor shows patch effect on x64 if merged compared to current head for main.
Results are based on clocktick event cycles. A negative change factor means clockticks are expected to be reduced.
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Compilation | -0.016877654557140742 |
| benchmarks/blake3-simd | x86_64 | Compilation | 0.08194057253790343 |
| benchmarks/bz2 | x86_64 | Compilation | -0.001293326919474369 |
| benchmarks/intgemm-simd | x86_64 | Compilation | -0.009588495143642461 |
| benchmarks/meshoptimizer | x86_64 | Compilation | -0.02159965580199552 |
| benchmarks/noop | x86_64 | Compilation | -0.2894639024518858 |
| benchmarks/pulldown-cmark | x86_64 | Compilation | -0.019353210340762872 |
| benchmarks/shootout-ackermann | x86_64 | Compilation | -0.055594086802220444 |
| benchmarks/shootout-base64 | x86_64 | Compilation | -0.03164354098077404 |
| benchmarks/shootout-ctype | x86_64 | Compilation | 0.1448569375874056 |
| benchmarks/shootout-ed25519 | x86_64 | Compilation | 0.00821986028470656 |
| benchmarks/shootout-fib2 | x86_64 | Compilation | 0.024443312098547887 |
| benchmarks/shootout-gimli | x86_64 | Compilation | 0.04459579472671149 |
| benchmarks/shootout-heapsort | x86_64 | Compilation | -0.025441690622511226 |
| benchmarks/shootout-keccak | x86_64 | Compilation | 0.009996809844224908 |
| benchmarks/shootout-matrix | x86_64 | Compilation | -0.018055091266589107 |
| benchmarks/shootout-memmove | x86_64 | Compilation | 0.24762007898001004 |
| benchmarks/shootout-minicsv | x86_64 | Compilation | -0.019298656956791227 |
| benchmarks/shootout-nestedloop | x86_64 | Compilation | -0.009667534546466183 |
| benchmarks/shootout-random | x86_64 | Compilation | 0.009769891503341954 |
| benchmarks/shootout-ratelimit | x86_64 | Compilation | -0.03739931195454593 |
| benchmarks/shootout-seqhash | x86_64 | Compilation | -0.023954709017668163 |
| benchmarks/shootout-sieve | x86_64 | Compilation | 0.01650291242777513 |
| benchmarks/shootout-switch | x86_64 | Compilation | -0.016781829762500866 |
| benchmarks/shootout-xblabla20 | x86_64 | Compilation | -0.08599663509325017 |
| benchmarks/shootout-xchacha20 | x86_64 | Compilation | 0.0548657356490041 |
| benchmarks/spidermonkey | x86_64 | Compilation | -0.0026511900732628657 |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Instantiation | 0.023697381397878248 |
| benchmarks/blake3-simd | x86_64 | Instantiation | -0.08575630607753515 |
| benchmarks/bz2 | x86_64 | Instantiation | 0.06238980295693608 |
| benchmarks/intgemm-simd | x86_64 | Instantiation | 0.5018498592338192 |
| benchmarks/meshoptimizer | x86_64 | Instantiation | 0.018559982363194116 |
| benchmarks/noop | x86_64 | Instantiation | -0.03731717318995764 |
| benchmarks/pulldown-cmark | x86_64 | Instantiation | -0.04042404473438954 |
| benchmarks/shootout-ackermann | x86_64 | Instantiation | 0.15718007662835243 |
| benchmarks/shootout-base64 | x86_64 | Instantiation | 0.005158011002327045 |
| benchmarks/shootout-ctype | x86_64 | Instantiation | -0.10890781902290425 |
| benchmarks/shootout-ed25519 | x86_64 | Instantiation | 0.017641275445221538 |
| benchmarks/shootout-fib2 | x86_64 | Instantiation | -0.06584443587954036 |
| benchmarks/shootout-gimli | x86_64 | Instantiation | 0.03424390876942551 |
| benchmarks/shootout-heapsort | x86_64 | Instantiation | -0.01295926366096034 |
| benchmarks/shootout-keccak | x86_64 | Instantiation | 0.025646595942406814 |
| benchmarks/shootout-matrix | x86_64 | Instantiation | -0.034629559029101586 |
| benchmarks/shootout-memmove | x86_64 | Instantiation | -0.011718319517063147 |
| benchmarks/shootout-minicsv | x86_64 | Instantiation | -0.08778494207961118 |
| benchmarks/shootout-nestedloop | x86_64 | Instantiation | -0.06191657927253469 |
| benchmarks/shootout-random | x86_64 | Instantiation | -0.053122494341652504 |
| benchmarks/shootout-ratelimit | x86_64 | Instantiation | -0.005403269725671955 |
| benchmarks/shootout-seqhash | x86_64 | Instantiation | -0.04719274461222012 |
| benchmarks/shootout-sieve | x86_64 | Instantiation | -0.048550838987954315 |
| benchmarks/shootout-switch | x86_64 | Instantiation | -0.0467495907039891 |
| benchmarks/shootout-xblabla20 | x86_64 | Instantiation | -0.09164158938770495 |
| benchmarks/shootout-xchacha20 | x86_64 | Instantiation | -0.08062254807383107 |
| benchmarks/spidermonkey | x86_64 | Instantiation | 0.04728436497448674 |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Execution | 0.009471334534076226 |
| benchmarks/blake3-simd | x86_64 | Execution | 0.01493971250286652 |
| benchmarks/bz2 | x86_64 | Execution | 0.019355660681109832 |
| benchmarks/intgemm-simd | x86_64 | Execution | 0.0016319015908159429 |
| benchmarks/meshoptimizer | x86_64 | Execution | -0.0005476686187887436 |
| benchmarks/noop | x86_64 | Execution | -0.0782800441014333 |
| benchmarks/pulldown-cmark | x86_64 | Execution | -0.010808958889479636 |
| benchmarks/shootout-ackermann | x86_64 | Execution | 0.15227070347284055 |
| benchmarks/shootout-base64 | x86_64 | Execution | 0.0006517844295184094 |
| benchmarks/shootout-ctype | x86_64 | Execution | 0.0044594885781508165 |
| benchmarks/shootout-ed25519 | x86_64 | Execution | 0.0010811335206950545 |
| benchmarks/shootout-fib2 | x86_64 | Execution | 0.0006661573249961972 |
| benchmarks/shootout-gimli | x86_64 | Execution | -0.004347453643022026 |
| benchmarks/shootout-heapsort | x86_64 | Execution | -0.00014424544596935984 |
| benchmarks/shootout-keccak | x86_64 | Execution | -0.00022426698237898446 |
| benchmarks/shootout-matrix | x86_64 | Execution | -0.00037431306349999804 |
| benchmarks/shootout-memmove | x86_64 | Execution | 0.002773553260052797 |
| benchmarks/shootout-minicsv | x86_64 | Execution | 0.0008652599489882284 |
| benchmarks/shootout-nestedloop | x86_64 | Execution | -0.002653378316691657 |
| benchmarks/shootout-random | x86_64 | Execution | 0.0018884376792083213 |
| benchmarks/shootout-ratelimit | x86_64 | Execution | 0.0007157019639774109 |
| benchmarks/shootout-seqhash | x86_64 | Execution | -0.0015390904276129103 |
| benchmarks/shootout-sieve | x86_64 | Execution | -0.000671673737887124 |
| benchmarks/shootout-switch | x86_64 | Execution | 0.0009044594915410542 |
| benchmarks/shootout-xblabla20 | x86_64 | Execution | 0.0015918002288561883 |
| benchmarks/shootout-xchacha20 | x86_64 | Execution | -0.010004292011202343 |
| benchmarks/spidermonkey | x86_64 | Execution | -0.00022767708333448766 |
| phase | change_factor |
|---|---|
| Compilation | -0.0015499487648833671 |
| Execution | 0.003831260255051592 |
| Instantiation | -0.00099593554009534 |
Change factor shows patch effect on x64 if merged compared to current head for main.
Results are based on clocktick event cycles. A negative change factor means clockticks are expected to be reduced.
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Compilation | -0.011370409887845323 |
| benchmarks/blake3-simd | x86_64 | Compilation | 0.03533098839455051 |
| benchmarks/bz2 | x86_64 | Compilation | 0.10592979261276358 |
| benchmarks/intgemm-simd | x86_64 | Compilation | 0.0076870822743826395 |
| benchmarks/meshoptimizer | x86_64 | Compilation | -0.0025180247389582355 |
| benchmarks/noop | x86_64 | Compilation | -0.01860976836495387 |
| benchmarks/pulldown-cmark | x86_64 | Compilation | 0.008369279516189154 |
| benchmarks/shootout-ackermann | x86_64 | Compilation | 0.044865430814119645 |
| benchmarks/shootout-base64 | x86_64 | Compilation | 0.042373294175259035 |
| benchmarks/shootout-ctype | x86_64 | Compilation | -0.031157146395578983 |
| benchmarks/shootout-ed25519 | x86_64 | Compilation | 0.002628724559716522 |
| benchmarks/shootout-fib2 | x86_64 | Compilation | 0.017862302639828354 |
| benchmarks/shootout-gimli | x86_64 | Compilation | 0.04394570872223258 |
| benchmarks/shootout-heapsort | x86_64 | Compilation | -0.007364347443149288 |
| benchmarks/shootout-keccak | x86_64 | Compilation | 0.07912842965739486 |
| benchmarks/shootout-matrix | x86_64 | Compilation | -0.05770538147200033 |
| benchmarks/shootout-memmove | x86_64 | Compilation | 0.04738441300871532 |
| benchmarks/shootout-minicsv | x86_64 | Compilation | 0.07935607888039065 |
| benchmarks/shootout-nestedloop | x86_64 | Compilation | -0.030468235875386607 |
| benchmarks/shootout-random | x86_64 | Compilation | -0.008788593495076769 |
| benchmarks/shootout-ratelimit | x86_64 | Compilation | -0.03840552491086813 |
| benchmarks/shootout-seqhash | x86_64 | Compilation | -0.08796585034354742 |
| benchmarks/shootout-sieve | x86_64 | Compilation | 0.005542906993256658 |
| benchmarks/shootout-switch | x86_64 | Compilation | 0.06221173680363923 |
| benchmarks/shootout-xblabla20 | x86_64 | Compilation | 0.02714806209918219 |
| benchmarks/shootout-xchacha20 | x86_64 | Compilation | 0.021130828520589784 |
| benchmarks/spidermonkey | x86_64 | Compilation | 0.002898530534388266 |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Instantiation | -0.005793472881306605 |
| benchmarks/blake3-simd | x86_64 | Instantiation | -0.020426153828308924 |
| benchmarks/bz2 | x86_64 | Instantiation | 0.07429545201537979 |
| benchmarks/intgemm-simd | x86_64 | Instantiation | 0.04688562567724097 |
| benchmarks/meshoptimizer | x86_64 | Instantiation | -0.003593091702273843 |
| benchmarks/noop | x86_64 | Instantiation | 0.13164984467045637 |
| benchmarks/pulldown-cmark | x86_64 | Instantiation | 0.022367136061493875 |
| benchmarks/shootout-ackermann | x86_64 | Instantiation | 0.05896575781033486 |
| benchmarks/shootout-base64 | x86_64 | Instantiation | -0.0034800499026024223 |
| benchmarks/shootout-ctype | x86_64 | Instantiation | 0.44235204974204123 |
| benchmarks/shootout-ed25519 | x86_64 | Instantiation | 0.017240820909218524 |
| benchmarks/shootout-fib2 | x86_64 | Instantiation | 0.013348033653743263 |
| benchmarks/shootout-gimli | x86_64 | Instantiation | 0.2158229108219154 |
| benchmarks/shootout-heapsort | x86_64 | Instantiation | -0.036380513981256635 |
| benchmarks/shootout-keccak | x86_64 | Instantiation | 0.5447192049919112 |
| benchmarks/shootout-matrix | x86_64 | Instantiation | 0.002815271456708235 |
| benchmarks/shootout-memmove | x86_64 | Instantiation | 0.004221820968810519 |
| benchmarks/shootout-minicsv | x86_64 | Instantiation | -0.01912871405870531 |
| benchmarks/shootout-nestedloop | x86_64 | Instantiation | -0.0034548335974643463 |
| benchmarks/shootout-random | x86_64 | Instantiation | 0.07646950855779377 |
| benchmarks/shootout-ratelimit | x86_64 | Instantiation | 0.007354113308607024 |
| benchmarks/shootout-seqhash | x86_64 | Instantiation | -0.22329499970712852 |
| benchmarks/shootout-sieve | x86_64 | Instantiation | 0.022520485701366555 |
| benchmarks/shootout-switch | x86_64 | Instantiation | 0.034247085750785056 |
| benchmarks/shootout-xblabla20 | x86_64 | Instantiation | 0.024809403605395408 |
| benchmarks/shootout-xchacha20 | x86_64 | Instantiation | 0.05298845140811781 |
| benchmarks/spidermonkey | x86_64 | Instantiation | 0.04137354466370269 |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Execution | -0.012441687259663214 |
| benchmarks/blake3-simd | x86_64 | Execution | -0.015347664795966942 |
| benchmarks/bz2 | x86_64 | Execution | -0.0073246895490997055 |
| benchmarks/intgemm-simd | x86_64 | Execution | -0.0011562976266117353 |
| benchmarks/meshoptimizer | x86_64 | Execution | -0.0049511514723130645 |
| benchmarks/noop | x86_64 | Execution | -0.42807505211952745 |
| benchmarks/pulldown-cmark | x86_64 | Execution | -0.004745607069370328 |
| benchmarks/shootout-ackermann | x86_64 | Execution | -0.18536251709986318 |
| benchmarks/shootout-base64 | x86_64 | Execution | -0.002964385181596807 |
| benchmarks/shootout-ctype | x86_64 | Execution | -0.0010776623458368384 |
| benchmarks/shootout-ed25519 | x86_64 | Execution | 0.001474859031769249 |
| benchmarks/shootout-fib2 | x86_64 | Execution | 0.00020381461093399444 |
| benchmarks/shootout-gimli | x86_64 | Execution | 0.004033363651319233 |
| benchmarks/shootout-heapsort | x86_64 | Execution | -0.00031291754610829337 |
| benchmarks/shootout-keccak | x86_64 | Execution | 0.001070864729466825 |
| benchmarks/shootout-matrix | x86_64 | Execution | 0.0010417024146387455 |
| benchmarks/shootout-memmove | x86_64 | Execution | 8.067331186700777e-05 |
| benchmarks/shootout-minicsv | x86_64 | Execution | 0.000281866583810908 |
| benchmarks/shootout-nestedloop | x86_64 | Execution | 0.007122287188371157 |
| benchmarks/shootout-random | x86_64 | Execution | 0.0020532744384276214 |
| benchmarks/shootout-ratelimit | x86_64 | Execution | -0.013445832080646758 |
| benchmarks/shootout-seqhash | x86_64 | Execution | -0.0016334605768543176 |
| benchmarks/shootout-sieve | x86_64 | Execution | 6.623481759393535e-05 |
| benchmarks/shootout-switch | x86_64 | Execution | 0.003914333184921626 |
| benchmarks/shootout-xblabla20 | x86_64 | Execution | -0.04419130212920164 |
| benchmarks/shootout-xchacha20 | x86_64 | Execution | 0.006499351564510425 |
| benchmarks/spidermonkey | x86_64 | Execution | -0.00021399195248172909 |
Averages
| phase | change_factor |
|---|---|
| Compilation | 0.012571863232564222 |
| Execution | -0.02575561456583375 |
| Instantiation | 0.05625535896725837 |
Will provide one more update to clarify the factor change and round the result
Change factor shows patch effect on x64 if merged compared to current head for main.
Results are based on clocktick (CT) event cycles. Change Factor = (Patched_CT - Main_CT) / (Main_CT) A negative change factor means clockticks are expected to be reduced by the patch.
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Compilation | -0.055 |
| benchmarks/blake3-simd | x86_64 | Compilation | -0.018 |
| benchmarks/bz2 | x86_64 | Compilation | -0.017 |
| benchmarks/intgemm-simd | x86_64 | Compilation | 0.000 |
| benchmarks/meshoptimizer | x86_64 | Compilation | -0.004 |
| benchmarks/noop | x86_64 | Compilation | -0.001 |
| benchmarks/pulldown-cmark | x86_64 | Compilation | -0.062 |
| benchmarks/shootout-ackermann | x86_64 | Compilation | 0.019 |
| benchmarks/shootout-base64 | x86_64 | Compilation | 0.004 |
| benchmarks/shootout-ctype | x86_64 | Compilation | -0.018 |
| benchmarks/shootout-ed25519 | x86_64 | Compilation | 0.000 |
| benchmarks/shootout-fib2 | x86_64 | Compilation | -0.014 |
| benchmarks/shootout-gimli | x86_64 | Compilation | 0.051 |
| benchmarks/shootout-heapsort | x86_64 | Compilation | 0.012 |
| benchmarks/shootout-keccak | x86_64 | Compilation | 0.027 |
| benchmarks/shootout-matrix | x86_64 | Compilation | -0.017 |
| benchmarks/shootout-memmove | x86_64 | Compilation | -0.022 |
| benchmarks/shootout-minicsv | x86_64 | Compilation | 0.016 |
| benchmarks/shootout-nestedloop | x86_64 | Compilation | -0.026 |
| benchmarks/shootout-random | x86_64 | Compilation | 0.027 |
| benchmarks/shootout-ratelimit | x86_64 | Compilation | -0.013 |
| benchmarks/shootout-seqhash | x86_64 | Compilation | 0.306 |
| benchmarks/shootout-sieve | x86_64 | Compilation | 0.015 |
| benchmarks/shootout-switch | x86_64 | Compilation | 0.054 |
| benchmarks/shootout-xblabla20 | x86_64 | Compilation | 0.033 |
| benchmarks/shootout-xchacha20 | x86_64 | Compilation | -0.086 |
| benchmarks/spidermonkey | x86_64 | Compilation | -0.013 |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Instantiation | 0.071 |
| benchmarks/blake3-simd | x86_64 | Instantiation | -0.037 |
| benchmarks/bz2 | x86_64 | Instantiation | -0.019 |
| benchmarks/intgemm-simd | x86_64 | Instantiation | 0.322 |
| benchmarks/meshoptimizer | x86_64 | Instantiation | 0.075 |
| benchmarks/noop | x86_64 | Instantiation | -0.066 |
| benchmarks/pulldown-cmark | x86_64 | Instantiation | -0.043 |
| benchmarks/shootout-ackermann | x86_64 | Instantiation | 0.003 |
| benchmarks/shootout-base64 | x86_64 | Instantiation | 0.065 |
| benchmarks/shootout-ctype | x86_64 | Instantiation | 0.049 |
| benchmarks/shootout-ed25519 | x86_64 | Instantiation | 0.010 |
| benchmarks/shootout-fib2 | x86_64 | Instantiation | -0.060 |
| benchmarks/shootout-gimli | x86_64 | Instantiation | 0.025 |
| benchmarks/shootout-heapsort | x86_64 | Instantiation | 0.008 |
| benchmarks/shootout-keccak | x86_64 | Instantiation | -0.030 |
| benchmarks/shootout-matrix | x86_64 | Instantiation | 0.039 |
| benchmarks/shootout-memmove | x86_64 | Instantiation | 0.005 |
| benchmarks/shootout-minicsv | x86_64 | Instantiation | -0.003 |
| benchmarks/shootout-nestedloop | x86_64 | Instantiation | 0.072 |
| benchmarks/shootout-random | x86_64 | Instantiation | -0.003 |
| benchmarks/shootout-ratelimit | x86_64 | Instantiation | 0.021 |
| benchmarks/shootout-seqhash | x86_64 | Instantiation | -0.111 |
| benchmarks/shootout-sieve | x86_64 | Instantiation | -0.036 |
| benchmarks/shootout-switch | x86_64 | Instantiation | 0.017 |
| benchmarks/shootout-xblabla20 | x86_64 | Instantiation | 0.022 |
| benchmarks/shootout-xchacha20 | x86_64 | Instantiation | -0.049 |
| benchmarks/spidermonkey | x86_64 | Instantiation | -0.147 |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Execution | 0.003 |
| benchmarks/blake3-simd | x86_64 | Execution | -0.011 |
| benchmarks/bz2 | x86_64 | Execution | -0.033 |
| benchmarks/intgemm-simd | x86_64 | Execution | -0.007 |
| benchmarks/meshoptimizer | x86_64 | Execution | 0.000 |
| benchmarks/noop | x86_64 | Execution | 0.454 |
| benchmarks/pulldown-cmark | x86_64 | Execution | -0.002 |
| benchmarks/shootout-ackermann | x86_64 | Execution | -0.350 |
| benchmarks/shootout-base64 | x86_64 | Execution | 0.003 |
| benchmarks/shootout-ctype | x86_64 | Execution | 0.003 |
| benchmarks/shootout-ed25519 | x86_64 | Execution | -0.000 |
| benchmarks/shootout-fib2 | x86_64 | Execution | -0.000 |
| benchmarks/shootout-gimli | x86_64 | Execution | -0.017 |
| benchmarks/shootout-heapsort | x86_64 | Execution | 0.000 |
| benchmarks/shootout-keccak | x86_64 | Execution | -0.006 |
| benchmarks/shootout-matrix | x86_64 | Execution | 0.001 |
| benchmarks/shootout-memmove | x86_64 | Execution | 0.002 |
| benchmarks/shootout-minicsv | x86_64 | Execution | -0.001 |
| benchmarks/shootout-nestedloop | x86_64 | Execution | 0.003 |
| benchmarks/shootout-random | x86_64 | Execution | 0.003 |
| benchmarks/shootout-ratelimit | x86_64 | Execution | -0.000 |
| benchmarks/shootout-seqhash | x86_64 | Execution | 0.004 |
| benchmarks/shootout-sieve | x86_64 | Execution | -0.001 |
| benchmarks/shootout-switch | x86_64 | Execution | -0.001 |
| benchmarks/shootout-xblabla20 | x86_64 | Execution | -0.025 |
| benchmarks/shootout-xchacha20 | x86_64 | Execution | 0.010 |
| benchmarks/spidermonkey | x86_64 | Execution | -0.000 |
Averages (x64):
| phase | change_factor |
|---|---|
| Compilation | 0.007 |
| Execution | 0.001 |
| Instantiation | 0.007 |
@cfallin I think this is the one to address some previous comments. Note, https://github.com/bytecodealliance/wasmtime/pull/5064 is a separate PR to look at better stabilizing results.
@jlb6740 a few thoughts:
- Can we label "Averages" at the bottom "Geomeans" (and to check: they are geometric means?) so the reader knows what kind they are?
- To me at least, multiplying all the numbers by 100 and presenting them as percentages would make them a bit easier to visually parse. E.g.
0.003, 0.001, -0.004is ever-so-slightly harder to read than0.3%, 0.1%, -0.4%. - Would it be possible to sort by effect size (most sped-up to most slowed-down for example)?
@cfallin. These are averages of what we decided to call the change factor (python pandas calls it percent change). I definetly don't think we want to take the geomean of these numbers. The numbers are already a percentage (and not based on a diff) .. so I think taking the arithmetic average is appropriate there. Note, I updated the comments to include the formula that is used:
Some Factor = (Patched_CT - Main_CT) / (Main_CT) or Patched Clock Ticks = Main Clock Ticks + (Main Clock Ticks * (Some Factor))
This makes sense to me, but multiplying "Some Factor" by 100 would break this formula. 0.003 factor is not the same as .3%. 1.003 factor is equivalent to .3%
As far as the effect size I think that is calculated in sightglass so should be doable. That said, I've found it takes a minute to noodle on these changes just because it takes so long to run and you don't know if you've broken something with your changes or to know the format is not quite like you want it. I don't want this to languish for a week while I attend to other things. Is it OK to do these other updates in another iteration? But of course close on the labels and formula here.
These are averages of what we decided to call the change factor (python pandas calls it percent change). I definetly don't think we want to take the geomean of these numbers. The numbers are already a percentage (and not based on a diff) .. so I think taking the arithmetic average is appropriate there.
Ah, right, a geomean is warranted if raw ratio of runtime, sorry; I had been thinking in those terms and not fractional-change terms. (Can we call it "arithmetic mean" in the header then to specify to the reader which it is?)
Some Factor = (Patched_CT - Main_CT) / (Main_CT)
This makes sense to me, but multiplying "Some Factor" by 100 would break this formula. 0.003 factor is not the same as .3%. 1.003 factor is equivalent to .3%
Isn't this just the definition of fractional change? The - Main_CT / Main_CT term is effectively subtracting one (the above formula can be rearranged to (Patched_CT / Main_CT) - 1). So if this formula reports a result of 0.003, then that is a multiplicative factor of 1.003 from old to new, and that is a 0.3% shift. In other words, if I have a runtime ratio of 1.003, then the run got 0.3% slower; to go from 1.003 to 0.3%, I subtract one and multiply by 100.
Ok .. I may be confusing something here but this is how I see it:
Patch = Main (1 + Factor) is what the current formula states. So .. let's say Main is 100 and Factor is -.003 then the Patch Clockticks would decrease to (100 - .3) = 99.7
If we take the same thing with % So .. let's say Main is 100 and Percentage is -.3% then the Patch Clockticks would decrease to (100 * .3) = 99.7
Ok .. this is why I don't like percentages 😁. I think you are right. Hopefully I can easily change this factor to percentage in pandas with ease. I'll just make that change as I do think it is easier to read.
Change factor shows patch effect on x64 if merged compared to current head for main.
Results are based on clocktick (CT) event cycles. Change Factor = (Patched_CT - Main_CT) / (Main_CT) A negative change factor means clockticks are expected to be reduced by the patch.
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Compilation | -2.067% |
| benchmarks/blake3-simd | x86_64 | Compilation | -9.731% |
| benchmarks/bz2 | x86_64 | Compilation | 5.358% |
| benchmarks/intgemm-simd | x86_64 | Compilation | 0.691% |
| benchmarks/meshoptimizer | x86_64 | Compilation | -1.587% |
| benchmarks/noop | x86_64 | Compilation | -1.157% |
| benchmarks/pulldown-cmark | x86_64 | Compilation | -7.943% |
| benchmarks/shootout-ackermann | x86_64 | Compilation | -3.513% |
| benchmarks/shootout-base64 | x86_64 | Compilation | 4.014% |
| benchmarks/shootout-ctype | x86_64 | Compilation | -1.046% |
| benchmarks/shootout-ed25519 | x86_64 | Compilation | 0.191% |
| benchmarks/shootout-fib2 | x86_64 | Compilation | -1.799% |
| benchmarks/shootout-gimli | x86_64 | Compilation | -1.431% |
| benchmarks/shootout-heapsort | x86_64 | Compilation | 2.065% |
| benchmarks/shootout-keccak | x86_64 | Compilation | -2.097% |
| benchmarks/shootout-matrix | x86_64 | Compilation | -5.134% |
| benchmarks/shootout-memmove | x86_64 | Compilation | -2.702% |
| benchmarks/shootout-minicsv | x86_64 | Compilation | -2.506% |
| benchmarks/shootout-nestedloop | x86_64 | Compilation | -2.062% |
| benchmarks/shootout-random | x86_64 | Compilation | -0.815% |
| benchmarks/shootout-ratelimit | x86_64 | Compilation | -0.740% |
| benchmarks/shootout-seqhash | x86_64 | Compilation | 9.665% |
| benchmarks/shootout-sieve | x86_64 | Compilation | 0.483% |
| benchmarks/shootout-switch | x86_64 | Compilation | -0.386% |
| benchmarks/shootout-xblabla20 | x86_64 | Compilation | -3.094% |
| benchmarks/shootout-xchacha20 | x86_64 | Compilation | -5.356% |
| benchmarks/spidermonkey | x86_64 | Compilation | -0.783% |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Instantiation | 1.770% |
| benchmarks/blake3-simd | x86_64 | Instantiation | -21.610% |
| benchmarks/bz2 | x86_64 | Instantiation | 6.219% |
| benchmarks/intgemm-simd | x86_64 | Instantiation | -2.431% |
| benchmarks/meshoptimizer | x86_64 | Instantiation | -1.874% |
| benchmarks/noop | x86_64 | Instantiation | -4.099% |
| benchmarks/pulldown-cmark | x86_64 | Instantiation | -7.633% |
| benchmarks/shootout-ackermann | x86_64 | Instantiation | 0.835% |
| benchmarks/shootout-base64 | x86_64 | Instantiation | 4.207% |
| benchmarks/shootout-ctype | x86_64 | Instantiation | 0.682% |
| benchmarks/shootout-ed25519 | x86_64 | Instantiation | -1.963% |
| benchmarks/shootout-fib2 | x86_64 | Instantiation | 1.302% |
| benchmarks/shootout-gimli | x86_64 | Instantiation | 11.633% |
| benchmarks/shootout-heapsort | x86_64 | Instantiation | 5.706% |
| benchmarks/shootout-keccak | x86_64 | Instantiation | 11.342% |
| benchmarks/shootout-matrix | x86_64 | Instantiation | 25.500% |
| benchmarks/shootout-memmove | x86_64 | Instantiation | 9.481% |
| benchmarks/shootout-minicsv | x86_64 | Instantiation | 0.009% |
| benchmarks/shootout-nestedloop | x86_64 | Instantiation | 1.024% |
| benchmarks/shootout-random | x86_64 | Instantiation | -2.402% |
| benchmarks/shootout-ratelimit | x86_64 | Instantiation | -4.735% |
| benchmarks/shootout-seqhash | x86_64 | Instantiation | 1.122% |
| benchmarks/shootout-sieve | x86_64 | Instantiation | 3.037% |
| benchmarks/shootout-switch | x86_64 | Instantiation | -2.586% |
| benchmarks/shootout-xblabla20 | x86_64 | Instantiation | 2.925% |
| benchmarks/shootout-xchacha20 | x86_64 | Instantiation | 5.166% |
| benchmarks/spidermonkey | x86_64 | Instantiation | -2.497% |
| wasm | arch | phase | change_factor |
|---|---|---|---|
| benchmarks/blake3-scalar | x86_64 | Execution | -0.293% |
| benchmarks/blake3-simd | x86_64 | Execution | -18.240% |
| benchmarks/bz2 | x86_64 | Execution | -0.483% |
| benchmarks/intgemm-simd | x86_64 | Execution | -0.143% |
| benchmarks/meshoptimizer | x86_64 | Execution | -0.128% |
| benchmarks/noop | x86_64 | Execution | -31.053% |
| benchmarks/pulldown-cmark | x86_64 | Execution | 0.558% |
| benchmarks/shootout-ackermann | x86_64 | Execution | -38.342% |
| benchmarks/shootout-base64 | x86_64 | Execution | -0.241% |
| benchmarks/shootout-ctype | x86_64 | Execution | 0.106% |
| benchmarks/shootout-ed25519 | x86_64 | Execution | -0.239% |
| benchmarks/shootout-fib2 | x86_64 | Execution | -0.129% |
| benchmarks/shootout-gimli | x86_64 | Execution | 2.898% |
| benchmarks/shootout-heapsort | x86_64 | Execution | 0.041% |
| benchmarks/shootout-keccak | x86_64 | Execution | 0.485% |
| benchmarks/shootout-matrix | x86_64 | Execution | -0.063% |
| benchmarks/shootout-memmove | x86_64 | Execution | 0.026% |
| benchmarks/shootout-minicsv | x86_64 | Execution | -0.130% |
| benchmarks/shootout-nestedloop | x86_64 | Execution | -0.345% |
| benchmarks/shootout-random | x86_64 | Execution | 0.014% |
| benchmarks/shootout-ratelimit | x86_64 | Execution | 0.223% |
| benchmarks/shootout-seqhash | x86_64 | Execution | -0.153% |
| benchmarks/shootout-sieve | x86_64 | Execution | 0.215% |
| benchmarks/shootout-switch | x86_64 | Execution | 0.132% |
| benchmarks/shootout-xblabla20 | x86_64 | Execution | -3.346% |
| benchmarks/shootout-xchacha20 | x86_64 | Execution | -1.062% |
| benchmarks/spidermonkey | x86_64 | Execution | 0.034% |
Averages (x64):
| phase | change_factor |
|---|---|
| Compilation | -1.240% |
| Execution | -3.321% |
| Instantiation | 1.486% |