fizzy icon indicating copy to clipboard operation
fizzy copied to clipboard

benchmark: add bls12 synthetic loop example

Open axic opened this issue 4 years ago • 8 comments

axic avatar Jun 08 '20 11:06 axic

Codecov Report

Merging #379 into master will not change coverage. The diff coverage is n/a.

@@           Coverage Diff           @@
##           master     #379   +/-   ##
=======================================
  Coverage   98.72%   98.72%           
=======================================
  Files          56       56           
  Lines        8660     8660           
=======================================
  Hits         8550     8550           
  Misses        110      110           

codecov[bot] avatar Jun 08 '20 11:06 codecov[bot]

@chfast @gumb0 should we merge this as a good basis for benchmarking comparison?

axic avatar Jun 25 '20 16:06 axic

How long does it run?

chfast avatar Jun 25 '20 18:06 chfast

How long does it run?

It looks like it runs 2x faster than the slowest pairing benchmark. Fine to me then.

chfast avatar Jun 25 '20 18:06 chfast

@cdetrio do you have a newer/different build of this?

axic avatar Jun 26 '20 13:06 axic

My benchmarks between 0.2.0 and 0.3.0:

fizzy/parse/bls12_websnark                    1239 us         1188 us         1170 rate=72.6548M/s size=86.324k
 wabt/parse/bls12_websnark                    3617 us         3575 us          401 rate=24.1454M/s size=86.324k
wasm3/parse/bls12_websnark                    98.7 us         96.8 us        12053 rate=892.146M/s size=86.324k
fizzy/instantiate/bls12_websnark              1324 us         1308 us         1014
 wabt/instantiate/bls12_websnark              4869 us         4330 us          361
wasm3/instantiate/bls12_websnark               150 us          145 us         9035
fizzy/execute/bls12_websnark/synth          507587 us       491826 us            3
 wabt/execute/bls12_websnark/synth          448672 us       437398 us            3
wasm3/execute/bls12_websnark/synth           98672 us        94976 us           15

vs

fizzy/parse/bls12_websnark                    1429 us         1411 us          979 rate=61.1893M/s size=86.324k
 wabt/parse/bls12_websnark                    3645 us         3539 us          402 rate=24.3947M/s size=86.324k
wasm3/parse/bls12_websnark                     103 us         97.8 us        13425 rate=882.507M/s size=86.324k
fizzy/instantiate/bls12_websnark              1736 us         1652 us          885
 wabt/instantiate/bls12_websnark              4411 us         4180 us          355
wasm3/instantiate/bls12_websnark               152 us          147 us         8261
fizzy/execute/bls12_websnark/synth          409873 us       403466 us            3
 wabt/execute/bls12_websnark/synth          447030 us       434259 us            3
wasm3/execute/bls12_websnark/synth           95460 us        94336 us           15

axic avatar Jul 29 '20 22:07 axic

Can we finally merge this?

chfast avatar Oct 19 '20 17:10 chfast

Can we finally merge this?

@chfast I think the only delay here was whether this would cause anything else to be GPL-3.0, because this code is.

axic avatar May 27 '22 15:05 axic