dvc-bench
dvc-bench copied to clipboard
Published
20 hours ago •
iterative
iterative
Try to fix OpenID Connect for Google Cloud
See https://github.com/iterative/dvc-bench/actions/runs/10840696905/job/30083510194
@0x2b3bfa0, also need to drop if: ${{ github.event_name == 'schedule' }} to really run them here.
Thu Sep 26 02:44:40 UTC 2024
dataset: small
project: example-get-started
------------------------------------------------------------------------ benchmark 'test_add_copy-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add[2.58.2] 3.6415 (1.81) 3.6415 (1.81) 3.6415 (1.81) 0.0000 (1.0) 3.6415 (1.81) 0.0000 (1.0) 0;0 0.2746 (0.55) 1 1
test_add_copy-add[3.10.0] 3.6235 (1.80) 3.6235 (1.80) 3.6235 (1.80) 0.0000 (1.0) 3.6235 (1.80) 0.0000 (1.0) 0;0 0.2760 (0.56) 1 1
test_add_copy-add[3.53.2] 3.2845 (1.63) 3.2845 (1.63) 3.2845 (1.63) 0.0000 (1.0) 3.2845 (1.63) 0.0000 (1.0) 0;0 0.3045 (0.61) 1 1
test_add_copy-add[main] 2.0158 (1.0) 2.0158 (1.0) 2.0158 (1.0) 0.0000 (1.0) 2.0158 (1.0) 0.0000 (1.0) 0;0 0.4961 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_copy-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_copy-add-noop[2.58.2] 1.8004 (2.79) 1.8004 (2.79) 1.8004 (2.79) 0.0000 (1.0) 1.8004 (2.79) 0.0000 (1.0) 0;0 0.5554 (0.36) 1 1
test_add_copy-add-noop[3.10.0] 1.4285 (2.22) 1.4285 (2.22) 1.4285 (2.22) 0.0000 (1.0) 1.4285 (2.22) 0.0000 (1.0) 0;0 0.7000 (0.45) 1 1
test_add_copy-add-noop[3.53.2] 1.3719 (2.13) 1.3719 (2.13) 1.3719 (2.13) 0.0000 (1.0) 1.3719 (2.13) 0.0000 (1.0) 0;0 0.7289 (0.47) 1 1
test_add_copy-add-noop[main] 0.6448 (1.0) 0.6448 (1.0) 0.6448 (1.0) 0.0000 (1.0) 0.6448 (1.0) 0.0000 (1.0) 0;0 1.5508 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add_hardlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add[2.58.2] 3.0346 (1.70) 3.0346 (1.70) 3.0346 (1.70) 0.0000 (1.0) 3.0346 (1.70) 0.0000 (1.0) 0;0 0.3295 (0.59) 1 1
test_add_hardlink-add[3.10.0] 3.0293 (1.70) 3.0293 (1.70) 3.0293 (1.70) 0.0000 (1.0) 3.0293 (1.70) 0.0000 (1.0) 0;0 0.3301 (0.59) 1 1
test_add_hardlink-add[3.53.2] 2.7379 (1.54) 2.7379 (1.54) 2.7379 (1.54) 0.0000 (1.0) 2.7379 (1.54) 0.0000 (1.0) 0;0 0.3652 (0.65) 1 1
test_add_hardlink-add[main] 1.7823 (1.0) 1.7823 (1.0) 1.7823 (1.0) 0.0000 (1.0) 1.7823 (1.0) 0.0000 (1.0) 0;0 0.5611 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_hardlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_hardlink-add-noop[2.58.2] 1.6809 (2.53) 1.6809 (2.53) 1.6809 (2.53) 0.0000 (1.0) 1.6809 (2.53) 0.0000 (1.0) 0;0 0.5949 (0.39) 1 1
test_add_hardlink-add-noop[3.10.0] 1.6218 (2.44) 1.6218 (2.44) 1.6218 (2.44) 0.0000 (1.0) 1.6218 (2.44) 0.0000 (1.0) 0;0 0.6166 (0.41) 1 1
test_add_hardlink-add-noop[3.53.2] 1.5057 (2.27) 1.5057 (2.27) 1.5057 (2.27) 0.0000 (1.0) 1.5057 (2.27) 0.0000 (1.0) 0;0 0.6641 (0.44) 1 1
test_add_hardlink-add-noop[main] 0.6639 (1.0) 0.6639 (1.0) 0.6639 (1.0) 0.0000 (1.0) 0.6639 (1.0) 0.0000 (1.0) 0;0 1.5063 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_add_symlink-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add[2.58.2] 3.1642 (1.37) 3.1642 (1.37) 3.1642 (1.37) 0.0000 (1.0) 3.1642 (1.37) 0.0000 (1.0) 0;0 0.3160 (0.73) 1 1
test_add_symlink-add[3.10.0] 3.1156 (1.35) 3.1156 (1.35) 3.1156 (1.35) 0.0000 (1.0) 3.1156 (1.35) 0.0000 (1.0) 0;0 0.3210 (0.74) 1 1
test_add_symlink-add[3.53.2] 2.8735 (1.25) 2.8735 (1.25) 2.8735 (1.25) 0.0000 (1.0) 2.8735 (1.25) 0.0000 (1.0) 0;0 0.3480 (0.80) 1 1
test_add_symlink-add[main] 2.3033 (1.0) 2.3033 (1.0) 2.3033 (1.0) 0.0000 (1.0) 2.3033 (1.0) 0.0000 (1.0) 0;0 0.4342 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_add_symlink-add-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_add_symlink-add-noop[2.58.2] 1.9087 (2.81) 1.9087 (2.81) 1.9087 (2.81) 0.0000 (1.0) 1.9087 (2.81) 0.0000 (1.0) 0;0 0.5239 (0.36) 1 1
test_add_symlink-add-noop[3.10.0] 1.9387 (2.85) 1.9387 (2.85) 1.9387 (2.85) 0.0000 (1.0) 1.9387 (2.85) 0.0000 (1.0) 0;0 0.5158 (0.35) 1 1
test_add_symlink-add-noop[3.53.2] 1.7659 (2.60) 1.7659 (2.60) 1.7659 (2.60) 0.0000 (1.0) 1.7659 (2.60) 0.0000 (1.0) 0;0 0.5663 (0.39) 1 1
test_add_symlink-add-noop[main] 0.6799 (1.0) 0.6799 (1.0) 0.6799 (1.0) 0.0000 (1.0) 0.6799 (1.0) 0.0000 (1.0) 0;0 1.4708 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_copy-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout[2.58.2] 2.0823 (1.16) 2.0823 (1.16) 2.0823 (1.16) 0.0000 (1.0) 2.0823 (1.16) 0.0000 (1.0) 0;0 0.4802 (0.86) 1 1
test_checkout_copy-checkout[3.10.0] 2.8243 (1.57) 2.8243 (1.57) 2.8243 (1.57) 0.0000 (1.0) 2.8243 (1.57) 0.0000 (1.0) 0;0 0.3541 (0.64) 1 1
test_checkout_copy-checkout[3.53.2] 1.7980 (1.0) 1.7980 (1.0) 1.7980 (1.0) 0.0000 (1.0) 1.7980 (1.0) 0.0000 (1.0) 0;0 0.5562 (1.0) 1 1
test_checkout_copy-checkout[main] 1.9246 (1.07) 1.9246 (1.07) 1.9246 (1.07) 0.0000 (1.0) 1.9246 (1.07) 0.0000 (1.0) 0;0 0.5196 (0.93) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-noop[2.58.2] 594.1495 (1.09) 594.1495 (1.09) 594.1495 (1.09) 0.0000 (1.0) 594.1495 (1.09) 0.0000 (1.0) 0;0 1.6831 (0.92) 1 1
test_checkout_copy-checkout-noop[3.10.0] 612.6751 (1.13) 612.6751 (1.13) 612.6751 (1.13) 0.0000 (1.0) 612.6751 (1.13) 0.0000 (1.0) 0;0 1.6322 (0.89) 1 1
test_checkout_copy-checkout-noop[3.53.2] 625.4610 (1.15) 625.4610 (1.15) 625.4610 (1.15) 0.0000 (1.0) 625.4610 (1.15) 0.0000 (1.0) 0;0 1.5988 (0.87) 1 1
test_checkout_copy-checkout-noop[main] 543.8396 (1.0) 543.8396 (1.0) 543.8396 (1.0) 0.0000 (1.0) 543.8396 (1.0) 0.0000 (1.0) 0;0 1.8388 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_copy-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_copy-checkout-update[2.58.2] 732.4483 (1.33) 732.4483 (1.33) 732.4483 (1.33) 0.0000 (1.0) 732.4483 (1.33) 0.0000 (1.0) 0;0 1.3653 (0.75) 1 1
test_checkout_copy-checkout-update[3.10.0] 665.9814 (1.20) 665.9814 (1.20) 665.9814 (1.20) 0.0000 (1.0) 665.9814 (1.20) 0.0000 (1.0) 0;0 1.5015 (0.83) 1 1
test_checkout_copy-checkout-update[3.53.2] 684.1563 (1.24) 684.1563 (1.24) 684.1563 (1.24) 0.0000 (1.0) 684.1563 (1.24) 0.0000 (1.0) 0;0 1.4617 (0.81) 1 1
test_checkout_copy-checkout-update[main] 552.7511 (1.0) 552.7511 (1.0) 552.7511 (1.0) 0.0000 (1.0) 552.7511 (1.0) 0.0000 (1.0) 0;0 1.8091 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_hardlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout[2.58.2] 1.3971 (1.19) 1.3971 (1.19) 1.3971 (1.19) 0.0000 (1.0) 1.3971 (1.19) 0.0000 (1.0) 0;0 0.7157 (0.84) 1 1
test_checkout_hardlink-checkout[3.10.0] 1.3140 (1.12) 1.3140 (1.12) 1.3140 (1.12) 0.0000 (1.0) 1.3140 (1.12) 0.0000 (1.0) 0;0 0.7611 (0.90) 1 1
test_checkout_hardlink-checkout[3.53.2] 1.1772 (1.0) 1.1772 (1.0) 1.1772 (1.0) 0.0000 (1.0) 1.1772 (1.0) 0.0000 (1.0) 0;0 0.8495 (1.0) 1 1
test_checkout_hardlink-checkout[main] 1.3885 (1.18) 1.3885 (1.18) 1.3885 (1.18) 0.0000 (1.0) 1.3885 (1.18) 0.0000 (1.0) 0;0 0.7202 (0.85) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-noop[2.58.2] 554.5962 (1.15) 554.5962 (1.15) 554.5962 (1.15) 0.0000 (1.0) 554.5962 (1.15) 0.0000 (1.0) 0;0 1.8031 (0.87) 1 1
test_checkout_hardlink-checkout-noop[3.10.0] 590.7200 (1.22) 590.7200 (1.22) 590.7200 (1.22) 0.0000 (1.0) 590.7200 (1.22) 0.0000 (1.0) 0;0 1.6928 (0.82) 1 1
test_checkout_hardlink-checkout-noop[3.53.2] 547.8361 (1.14) 547.8361 (1.14) 547.8361 (1.14) 0.0000 (1.0) 547.8361 (1.14) 0.0000 (1.0) 0;0 1.8254 (0.88) 1 1
test_checkout_hardlink-checkout-noop[main] 482.6672 (1.0) 482.6672 (1.0) 482.6672 (1.0) 0.0000 (1.0) 482.6672 (1.0) 0.0000 (1.0) 0;0 2.0718 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_hardlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_hardlink-checkout-update[2.58.2] 710.8713 (1.35) 710.8713 (1.35) 710.8713 (1.35) 0.0000 (1.0) 710.8713 (1.35) 0.0000 (1.0) 0;0 1.4067 (0.74) 1 1
test_checkout_hardlink-checkout-update[3.10.0] 637.1724 (1.21) 637.1724 (1.21) 637.1724 (1.21) 0.0000 (1.0) 637.1724 (1.21) 0.0000 (1.0) 0;0 1.5694 (0.83) 1 1
test_checkout_hardlink-checkout-update[3.53.2] 600.8939 (1.14) 600.8939 (1.14) 600.8939 (1.14) 0.0000 (1.0) 600.8939 (1.14) 0.0000 (1.0) 0;0 1.6642 (0.88) 1 1
test_checkout_hardlink-checkout-update[main] 527.6639 (1.0) 527.6639 (1.0) 527.6639 (1.0) 0.0000 (1.0) 527.6639 (1.0) 0.0000 (1.0) 0;0 1.8951 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_checkout_symlink-checkout': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout[2.58.2] 1.5248 (1.21) 1.5248 (1.21) 1.5248 (1.21) 0.0000 (1.0) 1.5248 (1.21) 0.0000 (1.0) 0;0 0.6558 (0.82) 1 1
test_checkout_symlink-checkout[3.10.0] 1.4172 (1.13) 1.4172 (1.13) 1.4172 (1.13) 0.0000 (1.0) 1.4172 (1.13) 0.0000 (1.0) 0;0 0.7056 (0.89) 1 1
test_checkout_symlink-checkout[3.53.2] 1.2565 (1.0) 1.2565 (1.0) 1.2565 (1.0) 0.0000 (1.0) 1.2565 (1.0) 0.0000 (1.0) 0;0 0.7958 (1.0) 1 1
test_checkout_symlink-checkout[main] 1.4590 (1.16) 1.4590 (1.16) 1.4590 (1.16) 0.0000 (1.0) 1.4590 (1.16) 0.0000 (1.0) 0;0 0.6854 (0.86) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-noop[2.58.2] 597.9390 (1.17) 597.9390 (1.17) 597.9390 (1.17) 0.0000 (1.0) 597.9390 (1.17) 0.0000 (1.0) 0;0 1.6724 (0.85) 1 1
test_checkout_symlink-checkout-noop[3.10.0] 598.7880 (1.17) 598.7880 (1.17) 598.7880 (1.17) 0.0000 (1.0) 598.7880 (1.17) 0.0000 (1.0) 0;0 1.6700 (0.85) 1 1
test_checkout_symlink-checkout-noop[3.53.2] 583.2133 (1.14) 583.2133 (1.14) 583.2133 (1.14) 0.0000 (1.0) 583.2133 (1.14) 0.0000 (1.0) 0;0 1.7146 (0.87) 1 1
test_checkout_symlink-checkout-noop[main] 509.6254 (1.0) 509.6254 (1.0) 509.6254 (1.0) 0.0000 (1.0) 509.6254 (1.0) 0.0000 (1.0) 0;0 1.9622 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_checkout_symlink-checkout-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_checkout_symlink-checkout-update[2.58.2] 765.3831 (1.31) 765.3831 (1.31) 765.3831 (1.31) 0.0000 (1.0) 765.3831 (1.31) 0.0000 (1.0) 0;0 1.3065 (0.76) 1 1
test_checkout_symlink-checkout-update[3.10.0] 689.4048 (1.18) 689.4048 (1.18) 689.4048 (1.18) 0.0000 (1.0) 689.4048 (1.18) 0.0000 (1.0) 0;0 1.4505 (0.85) 1 1
test_checkout_symlink-checkout-update[3.53.2] 664.3639 (1.14) 664.3639 (1.14) 664.3639 (1.14) 0.0000 (1.0) 664.3639 (1.14) 0.0000 (1.0) 0;0 1.5052 (0.88) 1 1
test_checkout_symlink-checkout-update[main] 585.2445 (1.0) 585.2445 (1.0) 585.2445 (1.0) 0.0000 (1.0) 585.2445 (1.0) 0.0000 (1.0) 0;0 1.7087 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed[2.58.2] 651.3416 (1.26) 651.3416 (1.26) 651.3416 (1.26) 0.0000 (1.0) 651.3416 (1.26) 0.0000 (1.0) 0;0 1.5353 (0.79) 1 1
test_data_status-data-changed[3.10.0] 605.6901 (1.17) 605.6901 (1.17) 605.6901 (1.17) 0.0000 (1.0) 605.6901 (1.17) 0.0000 (1.0) 0;0 1.6510 (0.85) 1 1
test_data_status-data-changed[3.53.2] 604.5622 (1.17) 604.5622 (1.17) 604.5622 (1.17) 0.0000 (1.0) 604.5622 (1.17) 0.0000 (1.0) 0;0 1.6541 (0.85) 1 1
test_data_status-data-changed[main] 516.5618 (1.0) 516.5618 (1.0) 516.5618 (1.0) 0.0000 (1.0) 516.5618 (1.0) 0.0000 (1.0) 0;0 1.9359 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-changed-noop[2.58.2] 644.2892 (1.24) 644.2892 (1.24) 644.2892 (1.24) 0.0000 (1.0) 644.2892 (1.24) 0.0000 (1.0) 0;0 1.5521 (0.80) 1 1
test_data_status-data-changed-noop[3.10.0] 601.0862 (1.16) 601.0862 (1.16) 601.0862 (1.16) 0.0000 (1.0) 601.0862 (1.16) 0.0000 (1.0) 0;0 1.6637 (0.86) 1 1
test_data_status-data-changed-noop[3.53.2] 594.9207 (1.15) 594.9207 (1.15) 594.9207 (1.15) 0.0000 (1.0) 594.9207 (1.15) 0.0000 (1.0) 0;0 1.6809 (0.87) 1 1
test_data_status-data-changed-noop[main] 518.5916 (1.0) 518.5916 (1.0) 518.5916 (1.0) 0.0000 (1.0) 518.5916 (1.0) 0.0000 (1.0) 0;0 1.9283 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-new[2.58.2] 1.5934 (1.68) 1.5934 (1.68) 1.5934 (1.68) 0.0000 (1.0) 1.5934 (1.68) 0.0000 (1.0) 0;0 0.6276 (0.59) 1 1
test_data_status-data-new[3.10.0] 1.5500 (1.64) 1.5500 (1.64) 1.5500 (1.64) 0.0000 (1.0) 1.5500 (1.64) 0.0000 (1.0) 0;0 0.6451 (0.61) 1 1
test_data_status-data-new[3.53.2] 1.5064 (1.59) 1.5064 (1.59) 1.5064 (1.59) 0.0000 (1.0) 1.5064 (1.59) 0.0000 (1.0) 0;0 0.6638 (0.63) 1 1
test_data_status-data-new[main] 0.9465 (1.0) 0.9465 (1.0) 0.9465 (1.0) 0.0000 (1.0) 0.9465 (1.0) 0.0000 (1.0) 0;0 1.0565 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_data_status-data-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status-data-noop[2.58.2] 641.9233 (1.22) 641.9233 (1.22) 641.9233 (1.22) 0.0000 (1.0) 641.9233 (1.22) 0.0000 (1.0) 0;0 1.5578 (0.82) 1 1
test_data_status-data-noop[3.10.0] 598.7561 (1.14) 598.7561 (1.14) 598.7561 (1.14) 0.0000 (1.0) 598.7561 (1.14) 0.0000 (1.0) 0;0 1.6701 (0.88) 1 1
test_data_status-data-noop[3.53.2] 586.9907 (1.12) 586.9907 (1.12) 586.9907 (1.12) 0.0000 (1.0) 586.9907 (1.12) 0.0000 (1.0) 0;0 1.7036 (0.90) 1 1
test_data_status-data-noop[main] 525.5627 (1.0) 525.5627 (1.0) 525.5627 (1.0) 0.0000 (1.0) 525.5627 (1.0) 0.0000 (1.0) 0;0 1.9027 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed[2.58.2] 1.1408 (1.09) 1.1408 (1.09) 1.1408 (1.09) 0.0000 (1.0) 1.1408 (1.09) 0.0000 (1.0) 0;0 0.8766 (0.92) 1 1
test_data_status_all_flags-data-changed[3.10.0] 1.0979 (1.05) 1.0979 (1.05) 1.0979 (1.05) 0.0000 (1.0) 1.0979 (1.05) 0.0000 (1.0) 0;0 0.9108 (0.95) 1 1
test_data_status_all_flags-data-changed[3.53.2] 1.0692 (1.02) 1.0692 (1.02) 1.0692 (1.02) 0.0000 (1.0) 1.0692 (1.02) 0.0000 (1.0) 0;0 0.9352 (0.98) 1 1
test_data_status_all_flags-data-changed[main] 1.0467 (1.0) 1.0467 (1.0) 1.0467 (1.0) 0.0000 (1.0) 1.0467 (1.0) 0.0000 (1.0) 0;0 0.9554 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-changed-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-changed-noop[2.58.2] 1.1393 (1.12) 1.1393 (1.12) 1.1393 (1.12) 0.0000 (1.0) 1.1393 (1.12) 0.0000 (1.0) 0;0 0.8777 (0.90) 1 1
test_data_status_all_flags-data-changed-noop[3.10.0] 1.1682 (1.15) 1.1682 (1.15) 1.1682 (1.15) 0.0000 (1.0) 1.1682 (1.15) 0.0000 (1.0) 0;0 0.8560 (0.87) 1 1
test_data_status_all_flags-data-changed-noop[3.53.2] 1.0717 (1.05) 1.0717 (1.05) 1.0717 (1.05) 0.0000 (1.0) 1.0717 (1.05) 0.0000 (1.0) 0;0 0.9331 (0.95) 1 1
test_data_status_all_flags-data-changed-noop[main] 1.0202 (1.0) 1.0202 (1.0) 1.0202 (1.0) 0.0000 (1.0) 1.0202 (1.0) 0.0000 (1.0) 0;0 0.9802 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-new': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-new[2.58.2] 2.0522 (1.34) 2.0522 (1.34) 2.0522 (1.34) 0.0000 (1.0) 2.0522 (1.34) 0.0000 (1.0) 0;0 0.4873 (0.75) 1 1
test_data_status_all_flags-data-new[3.10.0] 2.0317 (1.32) 2.0317 (1.32) 2.0317 (1.32) 0.0000 (1.0) 2.0317 (1.32) 0.0000 (1.0) 0;0 0.4922 (0.76) 1 1
test_data_status_all_flags-data-new[3.53.2] 1.9071 (1.24) 1.9071 (1.24) 1.9071 (1.24) 0.0000 (1.0) 1.9071 (1.24) 0.0000 (1.0) 0;0 0.5244 (0.80) 1 1
test_data_status_all_flags-data-new[main] 1.5341 (1.0) 1.5341 (1.0) 1.5341 (1.0) 0.0000 (1.0) 1.5341 (1.0) 0.0000 (1.0) 0;0 0.6519 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_data_status_all_flags-data-noop': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_data_status_all_flags-data-noop[2.58.2] 1.1529 (1.16) 1.1529 (1.16) 1.1529 (1.16) 0.0000 (1.0) 1.1529 (1.16) 0.0000 (1.0) 0;0 0.8674 (0.86) 1 1
test_data_status_all_flags-data-noop[3.10.0] 1.1019 (1.11) 1.1019 (1.11) 1.1019 (1.11) 0.0000 (1.0) 1.1019 (1.11) 0.0000 (1.0) 0;0 0.9076 (0.90) 1 1
test_data_status_all_flags-data-noop[3.53.2] 1.0441 (1.05) 1.0441 (1.05) 1.0441 (1.05) 0.0000 (1.0) 1.0441 (1.05) 0.0000 (1.0) 0;0 0.9577 (0.95) 1 1
test_data_status_all_flags-data-noop[main] 0.9939 (1.0) 0.9939 (1.0) 0.9939 (1.0) 0.0000 (1.0) 0.9939 (1.0) 0.0000 (1.0) 0;0 1.0061 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_diff-diff': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff[2.58.2] 1.4507 (1.30) 1.4507 (1.30) 1.4507 (1.30) 0.0000 (1.0) 1.4507 (1.30) 0.0000 (1.0) 0;0 0.6893 (0.77) 1 1
test_diff-diff[3.10.0] 1.5345 (1.37) 1.5345 (1.37) 1.5345 (1.37) 0.0000 (1.0) 1.5345 (1.37) 0.0000 (1.0) 0;0 0.6517 (0.73) 1 1
test_diff-diff[3.53.2] 1.3982 (1.25) 1.3982 (1.25) 1.3982 (1.25) 0.0000 (1.0) 1.3982 (1.25) 0.0000 (1.0) 0;0 0.7152 (0.80) 1 1
test_diff-diff[main] 1.1170 (1.0) 1.1170 (1.0) 1.1170 (1.0) 0.0000 (1.0) 1.1170 (1.0) 0.0000 (1.0) 0;0 0.8952 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed[2.58.2] 675.7476 (1.21) 675.7476 (1.21) 675.7476 (1.21) 0.0000 (1.0) 675.7476 (1.21) 0.0000 (1.0) 0;0 1.4798 (0.83) 1 1
test_diff-diff-changed[3.10.0] 685.0581 (1.23) 685.0581 (1.23) 685.0581 (1.23) 0.0000 (1.0) 685.0581 (1.23) 0.0000 (1.0) 0;0 1.4597 (0.82) 1 1
test_diff-diff-changed[3.53.2] 631.3614 (1.13) 631.3614 (1.13) 631.3614 (1.13) 0.0000 (1.0) 631.3614 (1.13) 0.0000 (1.0) 0;0 1.5839 (0.88) 1 1
test_diff-diff-changed[main] 558.5883 (1.0) 558.5883 (1.0) 558.5883 (1.0) 0.0000 (1.0) 558.5883 (1.0) 0.0000 (1.0) 0;0 1.7902 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-changed-noop[2.58.2] 643.9426 (1.15) 643.9426 (1.15) 643.9426 (1.15) 0.0000 (1.0) 643.9426 (1.15) 0.0000 (1.0) 0;0 1.5529 (0.87) 1 1
test_diff-diff-changed-noop[3.10.0] 655.5297 (1.17) 655.5297 (1.17) 655.5297 (1.17) 0.0000 (1.0) 655.5297 (1.17) 0.0000 (1.0) 0;0 1.5255 (0.86) 1 1
test_diff-diff-changed-noop[3.53.2] 648.9959 (1.16) 648.9959 (1.16) 648.9959 (1.16) 0.0000 (1.0) 648.9959 (1.16) 0.0000 (1.0) 0;0 1.5408 (0.87) 1 1
test_diff-diff-changed-noop[main] 561.7384 (1.0) 561.7384 (1.0) 561.7384 (1.0) 0.0000 (1.0) 561.7384 (1.0) 0.0000 (1.0) 0;0 1.7802 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_diff-diff-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_diff-diff-noop[2.58.2] 612.0009 (1.09) 612.0009 (1.09) 612.0009 (1.09) 0.0000 (1.0) 612.0009 (1.09) 0.0000 (1.0) 0;0 1.6340 (0.92) 1 1
test_diff-diff-noop[3.10.0] 622.5800 (1.11) 622.5800 (1.11) 622.5800 (1.11) 0.0000 (1.0) 622.5800 (1.11) 0.0000 (1.0) 0;0 1.6062 (0.90) 1 1
test_diff-diff-noop[3.53.2] 628.3086 (1.12) 628.3086 (1.12) 628.3086 (1.12) 0.0000 (1.0) 628.3086 (1.12) 0.0000 (1.0) 0;0 1.5916 (0.89) 1 1
test_diff-diff-noop[main] 561.2602 (1.0) 561.2602 (1.0) 561.2602 (1.0) 0.0000 (1.0) 561.2602 (1.0) 0.0000 (1.0) 0;0 1.7817 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_exp_show-exp': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_exp_show-exp[2.58.2] 1.1077 (1.0) 1.1077 (1.0) 1.1077 (1.0) 0.0000 (1.0) 1.1077 (1.0) 0.0000 (1.0) 0;0 0.9028 (1.0) 1 1
test_exp_show-exp[3.10.0] 8.5134 (7.69) 8.5134 (7.69) 8.5134 (7.69) 0.0000 (1.0) 8.5134 (7.69) 0.0000 (1.0) 0;0 0.1175 (0.13) 1 1
test_exp_show-exp[3.53.2] 5.3627 (4.84) 5.3627 (4.84) 5.3627 (4.84) 0.0000 (1.0) 5.3627 (4.84) 0.0000 (1.0) 0;0 0.1865 (0.21) 1 1
test_exp_show-exp[main] 6.7584 (6.10) 6.7584 (6.10) 6.7584 (6.10) 0.0000 (1.0) 6.7584 (6.10) 0.0000 (1.0) 0;0 0.1480 (0.16) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_fetch-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_fetch-fetch[2.58.2] 2.7458 (1.71) 2.7458 (1.71) 2.7458 (1.71) 0.0000 (1.0) 2.7458 (1.71) 0.0000 (1.0) 0;0 0.3642 (0.58) 1 1
test_fetch-fetch[3.10.0] 3.2008 (1.99) 3.2008 (1.99) 3.2008 (1.99) 0.0000 (1.0) 3.2008 (1.99) 0.0000 (1.0) 0;0 0.3124 (0.50) 1 1
test_fetch-fetch[3.53.2] 2.0046 (1.25) 2.0046 (1.25) 2.0046 (1.25) 0.0000 (1.0) 2.0046 (1.25) 0.0000 (1.0) 0;0 0.4989 (0.80) 1 1
test_fetch-fetch[main] 1.6046 (1.0) 1.6046 (1.0) 1.6046 (1.0) 0.0000 (1.0) 1.6046 (1.0) 0.0000 (1.0) 0;0 0.6232 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_gc-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_gc-gc[2.58.2] 624.3138 (1.0) 624.3138 (1.0) 624.3138 (1.0) 0.0000 (1.0) 624.3138 (1.0) 0.0000 (1.0) 0;0 1.6018 (1.0) 1 1
test_gc-gc[3.10.0] 813.4545 (1.30) 813.4545 (1.30) 813.4545 (1.30) 0.0000 (1.0) 813.4545 (1.30) 0.0000 (1.0) 0;0 1.2293 (0.77) 1 1
test_gc-gc[3.53.2] 656.2094 (1.05) 656.2094 (1.05) 656.2094 (1.05) 0.0000 (1.0) 656.2094 (1.05) 0.0000 (1.0) 0;0 1.5239 (0.95) 1 1
test_gc-gc[main] 631.9312 (1.01) 631.9312 (1.01) 631.9312 (1.01) 0.0000 (1.0) 631.9312 (1.01) 0.0000 (1.0) 0;0 1.5825 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get-get': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get-get[2.58.2] 4.3652 (1.98) 4.3652 (1.98) 4.3652 (1.98) 0.0000 (1.0) 4.3652 (1.98) 0.0000 (1.0) 0;0 0.2291 (0.50) 1 1
test_get-get[3.10.0] 5.0475 (2.29) 5.0475 (2.29) 5.0475 (2.29) 0.0000 (1.0) 5.0475 (2.29) 0.0000 (1.0) 0;0 0.1981 (0.44) 1 1
test_get-get[3.53.2] 4.4074 (2.00) 4.4074 (2.00) 4.4074 (2.00) 0.0000 (1.0) 4.4074 (2.00) 0.0000 (1.0) 0;0 0.2269 (0.50) 1 1
test_get-get[main] 2.2034 (1.0) 2.2034 (1.0) 2.2034 (1.0) 0.0000 (1.0) 2.2034 (1.0) 0.0000 (1.0) 0;0 0.4538 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_get_url-get-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_get_url-get-url[2.58.2] 1.8685 (1.87) 1.8685 (1.87) 1.8685 (1.87) 0.0000 (1.0) 1.8685 (1.87) 0.0000 (1.0) 0;0 0.5352 (0.54) 1 1
test_get_url-get-url[3.10.0] 2.1316 (2.13) 2.1316 (2.13) 2.1316 (2.13) 0.0000 (1.0) 2.1316 (2.13) 0.0000 (1.0) 0;0 0.4691 (0.47) 1 1
test_get_url-get-url[3.53.2] 1.0368 (1.04) 1.0368 (1.04) 1.0368 (1.04) 0.0000 (1.0) 1.0368 (1.04) 0.0000 (1.0) 0;0 0.9645 (0.97) 1 1
test_get_url-get-url[main] 1.0016 (1.0) 1.0016 (1.0) 1.0016 (1.0) 0.0000 (1.0) 1.0016 (1.0) 0.0000 (1.0) 0;0 0.9984 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_help---help': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_help---help[2.58.2] 122.1835 (1.01) 129.0419 (1.0) 124.1906 (1.02) 1.2792 (1.06) 123.8331 (1.02) 1.1286 (1.32) 20;10 8.0521 (0.98) 100 1
test_help---help[3.10.0] 120.4878 (1.0) 131.3895 (1.02) 121.9230 (1.0) 1.2038 (1.0) 121.7590 (1.0) 0.8544 (1.0) 9;2 8.2019 (1.0) 100 1
test_help---help[3.53.2] 122.8607 (1.02) 145.2542 (1.13) 125.4348 (1.03) 2.9490 (2.45) 124.5961 (1.02) 1.5410 (1.80) 10;14 7.9723 (0.97) 100 1
test_help---help[main] 122.7239 (1.02) 148.5795 (1.15) 124.8653 (1.02) 2.8220 (2.34) 124.3734 (1.02) 0.9731 (1.14) 5;7 8.0086 (0.98) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import-import': 3 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import-import[2.58.2] 7.5243 (2.00) 7.5243 (2.00) 7.5243 (2.00) 0.0000 (1.0) 7.5243 (2.00) 0.0000 (1.0) 0;0 0.1329 (0.50) 1 1
test_import-import[3.10.0] 8.3345 (2.21) 8.3345 (2.21) 8.3345 (2.21) 0.0000 (1.0) 8.3345 (2.21) 0.0000 (1.0) 0;0 0.1200 (0.45) 1 1
test_import-import[main] 3.7657 (1.0) 3.7657 (1.0) 3.7657 (1.0) 0.0000 (1.0) 3.7657 (1.0) 0.0000 (1.0) 0;0 0.2656 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_import_url-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_import_url-import-url[2.58.2] 6.8945 (2.43) 6.8945 (2.43) 6.8945 (2.43) 0.0000 (1.0) 6.8945 (2.43) 0.0000 (1.0) 0;0 0.1450 (0.41) 1 1
test_import_url-import-url[3.10.0] 6.1903 (2.18) 6.1903 (2.18) 6.1903 (2.18) 0.0000 (1.0) 6.1903 (2.18) 0.0000 (1.0) 0;0 0.1615 (0.46) 1 1
test_import_url-import-url[3.53.2] 4.7533 (1.67) 4.7533 (1.67) 4.7533 (1.67) 0.0000 (1.0) 4.7533 (1.67) 0.0000 (1.0) 0;0 0.2104 (0.60) 1 1
test_import_url-import-url[main] 2.8402 (1.0) 2.8402 (1.0) 2.8402 (1.0) 0.0000 (1.0) 2.8402 (1.0) 0.0000 (1.0) 0;0 0.3521 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_init-init': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_init-init[2.58.2] 393.2795 (1.0) 465.6974 (1.02) 418.9845 (1.0) 13.4326 (1.08) 418.7779 (1.0) 18.7440 (1.27) 37;1 2.3867 (1.0) 100 1
test_init-init[3.10.0] 409.9857 (1.04) 472.9734 (1.04) 430.2260 (1.03) 12.3872 (1.0) 429.8772 (1.03) 14.9811 (1.01) 28;4 2.3244 (0.97) 100 1
test_init-init[3.53.2] 401.0184 (1.02) 455.8749 (1.0) 421.5629 (1.01) 13.5353 (1.09) 420.5020 (1.00) 19.3845 (1.31) 35;0 2.3721 (0.99) 100 1
test_init-init[main] 405.6667 (1.03) 501.6968 (1.10) 432.8153 (1.03) 13.4558 (1.09) 432.5545 (1.03) 14.7811 (1.0) 25;2 2.3105 (0.97) 100 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
---------------------------------------------------------------------------- benchmark 'test_list-list': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list[2.58.2] 594.7322 (1.09) 594.7322 (1.09) 594.7322 (1.09) 0.0000 (1.0) 594.7322 (1.09) 0.0000 (1.0) 0;0 1.6814 (0.92) 1 1
test_list-list[3.10.0] 681.5291 (1.24) 681.5291 (1.24) 681.5291 (1.24) 0.0000 (1.0) 681.5291 (1.24) 0.0000 (1.0) 0;0 1.4673 (0.80) 1 1
test_list-list[3.53.2] 578.5625 (1.06) 578.5625 (1.06) 578.5625 (1.06) 0.0000 (1.0) 578.5625 (1.06) 0.0000 (1.0) 0;0 1.7284 (0.95) 1 1
test_list-list[main] 547.8158 (1.0) 547.8158 (1.0) 547.8158 (1.0) 0.0000 (1.0) 547.8158 (1.0) 0.0000 (1.0) 0;0 1.8254 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-dvc-only': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-dvc-only[2.58.2] 430.0296 (1.04) 430.0296 (1.04) 430.0296 (1.04) 0.0000 (1.0) 430.0296 (1.04) 0.0000 (1.0) 0;0 2.3254 (0.96) 1 1
test_list-list-dvc-only[3.10.0] 430.3648 (1.04) 430.3648 (1.04) 430.3648 (1.04) 0.0000 (1.0) 430.3648 (1.04) 0.0000 (1.0) 0;0 2.3236 (0.96) 1 1
test_list-list-dvc-only[3.53.2] 439.2375 (1.06) 439.2375 (1.06) 439.2375 (1.06) 0.0000 (1.0) 439.2375 (1.06) 0.0000 (1.0) 0;0 2.2767 (0.94) 1 1
test_list-list-dvc-only[main] 413.8468 (1.0) 413.8468 (1.0) 413.8468 (1.0) 0.0000 (1.0) 413.8468 (1.0) 0.0000 (1.0) 0;0 2.4164 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-recursive': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-recursive[2.58.2] 517.0325 (1.07) 517.0325 (1.07) 517.0325 (1.07) 0.0000 (1.0) 517.0325 (1.07) 0.0000 (1.0) 0;0 1.9341 (0.94) 1 1
test_list-list-recursive[3.10.0] 508.2704 (1.05) 508.2704 (1.05) 508.2704 (1.05) 0.0000 (1.0) 508.2704 (1.05) 0.0000 (1.0) 0;0 1.9675 (0.95) 1 1
test_list-list-recursive[3.53.2] 501.9083 (1.04) 501.9083 (1.04) 501.9083 (1.04) 0.0000 (1.0) 501.9083 (1.04) 0.0000 (1.0) 0;0 1.9924 (0.97) 1 1
test_list-list-recursive[main] 484.7731 (1.0) 484.7731 (1.0) 484.7731 (1.0) 0.0000 (1.0) 484.7731 (1.0) 0.0000 (1.0) 0;0 2.0628 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_list-list-shallow': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_list-list-shallow[2.58.2] 439.7303 (1.07) 439.7303 (1.07) 439.7303 (1.07) 0.0000 (1.0) 439.7303 (1.07) 0.0000 (1.0) 0;0 2.2741 (0.94) 1 1
test_list-list-shallow[3.10.0] 430.2048 (1.04) 430.2048 (1.04) 430.2048 (1.04) 0.0000 (1.0) 430.2048 (1.04) 0.0000 (1.0) 0;0 2.3245 (0.96) 1 1
test_list-list-shallow[3.53.2] 416.9505 (1.01) 416.9505 (1.01) 416.9505 (1.01) 0.0000 (1.0) 416.9505 (1.01) 0.0000 (1.0) 0;0 2.3984 (0.99) 1 1
test_list-list-shallow[main] 412.7413 (1.0) 412.7413 (1.0) 412.7413 (1.0) 0.0000 (1.0) 412.7413 (1.0) 0.0000 (1.0) 0;0 2.4228 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_add-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add[2.58.2] 2.1904 (1.34) 2.1904 (1.34) 2.1904 (1.34) 0.0000 (1.0) 2.1904 (1.34) 0.0000 (1.0) 0;0 0.4565 (0.75) 1 1
test_partial_add-add[3.10.0] 2.2237 (1.36) 2.2237 (1.36) 2.2237 (1.36) 0.0000 (1.0) 2.2237 (1.36) 0.0000 (1.0) 0;0 0.4497 (0.74) 1 1
test_partial_add-add[3.53.2] 1.9948 (1.22) 1.9948 (1.22) 1.9948 (1.22) 0.0000 (1.0) 1.9948 (1.22) 0.0000 (1.0) 0;0 0.5013 (0.82) 1 1
test_partial_add-add[main] 1.6359 (1.0) 1.6359 (1.0) 1.6359 (1.0) 0.0000 (1.0) 1.6359 (1.0) 0.0000 (1.0) 0;0 0.6113 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-add-partial': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-add-partial[2.58.2] 2.9758 (2.98) 2.9758 (2.98) 2.9758 (2.98) 0.0000 (1.0) 2.9758 (2.98) 0.0000 (1.0) 0;0 0.3360 (0.34) 1 1
test_partial_add-add-partial[3.10.0] 2.8742 (2.87) 2.8742 (2.87) 2.8742 (2.87) 0.0000 (1.0) 2.8742 (2.87) 0.0000 (1.0) 0;0 0.3479 (0.35) 1 1
test_partial_add-add-partial[3.53.2] 2.5977 (2.60) 2.5977 (2.60) 2.5977 (2.60) 0.0000 (1.0) 2.5977 (2.60) 0.0000 (1.0) 0;0 0.3850 (0.39) 1 1
test_partial_add-add-partial[main] 1.0002 (1.0) 1.0002 (1.0) 1.0002 (1.0) 0.0000 (1.0) 1.0002 (1.0) 0.0000 (1.0) 0;0 0.9998 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-cloud-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-cloud-noop[2.58.2] 560.4566 (1.0) 560.4566 (1.0) 560.4566 (1.0) 0.0000 (1.0) 560.4566 (1.0) 0.0000 (1.0) 0;0 1.7843 (1.0) 1 1
test_partial_add-gc-cloud-noop[3.10.0] 918.6666 (1.64) 918.6666 (1.64) 918.6666 (1.64) 0.0000 (1.0) 918.6666 (1.64) 0.0000 (1.0) 0;0 1.0885 (0.61) 1 1
test_partial_add-gc-cloud-noop[3.53.2] 618.4239 (1.10) 618.4239 (1.10) 618.4239 (1.10) 0.0000 (1.0) 618.4239 (1.10) 0.0000 (1.0) 0;0 1.6170 (0.91) 1 1
test_partial_add-gc-cloud-noop[main] 613.7125 (1.10) 613.7125 (1.10) 613.7125 (1.10) 0.0000 (1.0) 613.7125 (1.10) 0.0000 (1.0) 0;0 1.6294 (0.91) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_add-gc-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-gc-noop[2.58.2] 489.5261 (1.0) 489.5261 (1.0) 489.5261 (1.0) 0.0000 (1.0) 489.5261 (1.0) 0.0000 (1.0) 0;0 2.0428 (1.0) 1 1
test_partial_add-gc-noop[3.10.0] 663.9842 (1.36) 663.9842 (1.36) 663.9842 (1.36) 0.0000 (1.0) 663.9842 (1.36) 0.0000 (1.0) 0;0 1.5061 (0.74) 1 1
test_partial_add-gc-noop[3.53.2] 518.4514 (1.06) 518.4514 (1.06) 518.4514 (1.06) 0.0000 (1.0) 518.4514 (1.06) 0.0000 (1.0) 0;0 1.9288 (0.94) 1 1
test_partial_add-gc-noop[main] 529.5970 (1.08) 529.5970 (1.08) 529.5970 (1.08) 0.0000 (1.0) 529.5970 (1.08) 0.0000 (1.0) 0;0 1.8882 (0.92) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push[2.58.2] 1.2837 (1.25) 1.2837 (1.25) 1.2837 (1.25) 0.0000 (1.0) 1.2837 (1.25) 0.0000 (1.0) 0;0 0.7790 (0.80) 1 1
test_partial_add-push[3.10.0] 1.1928 (1.17) 1.1928 (1.17) 1.1928 (1.17) 0.0000 (1.0) 1.1928 (1.17) 0.0000 (1.0) 0;0 0.8384 (0.86) 1 1
test_partial_add-push[3.53.2] 1.0644 (1.04) 1.0644 (1.04) 1.0644 (1.04) 0.0000 (1.0) 1.0644 (1.04) 0.0000 (1.0) 0;0 0.9395 (0.96) 1 1
test_partial_add-push[main] 1.0235 (1.0) 1.0235 (1.0) 1.0235 (1.0) 0.0000 (1.0) 1.0235 (1.0) 0.0000 (1.0) 0;0 0.9770 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_add-push-partial': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_add-push-partial[2.58.2] 1.3376 (1.22) 1.3376 (1.22) 1.3376 (1.22) 0.0000 (1.0) 1.3376 (1.22) 0.0000 (1.0) 0;0 0.7476 (0.82) 1 1
test_partial_add-push-partial[3.10.0] 1.3506 (1.23) 1.3506 (1.23) 1.3506 (1.23) 0.0000 (1.0) 1.3506 (1.23) 0.0000 (1.0) 0;0 0.7404 (0.81) 1 1
test_partial_add-push-partial[3.53.2] 1.1319 (1.03) 1.1319 (1.03) 1.1319 (1.03) 0.0000 (1.0) 1.1319 (1.03) 0.0000 (1.0) 0;0 0.8835 (0.97) 1 1
test_partial_add-push-partial[main] 1.0988 (1.0) 1.0988 (1.0) 1.0988 (1.0) 0.0000 (1.0) 1.0988 (1.0) 0.0000 (1.0) 0;0 0.9101 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_partial_remove-add': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add[2.58.2] 3.6920 (1.80) 3.6920 (1.80) 3.6920 (1.80) 0.0000 (1.0) 3.6920 (1.80) 0.0000 (1.0) 0;0 0.2709 (0.56) 1 1
test_partial_remove-add[3.10.0] 3.6655 (1.79) 3.6655 (1.79) 3.6655 (1.79) 0.0000 (1.0) 3.6655 (1.79) 0.0000 (1.0) 0;0 0.2728 (0.56) 1 1
test_partial_remove-add[3.53.2] 3.2830 (1.60) 3.2830 (1.60) 3.2830 (1.60) 0.0000 (1.0) 3.2830 (1.60) 0.0000 (1.0) 0;0 0.3046 (0.63) 1 1
test_partial_remove-add[main] 2.0530 (1.0) 2.0530 (1.0) 2.0530 (1.0) 0.0000 (1.0) 2.0530 (1.0) 0.0000 (1.0) 0;0 0.4871 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-add-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-add-update[2.58.2] 1.5009 (2.50) 1.5009 (2.50) 1.5009 (2.50) 0.0000 (1.0) 1.5009 (2.50) 0.0000 (1.0) 0;0 0.6663 (0.40) 1 1
test_partial_remove-add-update[3.10.0] 1.4627 (2.44) 1.4627 (2.44) 1.4627 (2.44) 0.0000 (1.0) 1.4627 (2.44) 0.0000 (1.0) 0;0 0.6836 (0.41) 1 1
test_partial_remove-add-update[3.53.2] 1.3257 (2.21) 1.3257 (2.21) 1.3257 (2.21) 0.0000 (1.0) 1.3257 (2.21) 0.0000 (1.0) 0;0 0.7543 (0.45) 1 1
test_partial_remove-add-update[main] 0.5997 (1.0) 0.5997 (1.0) 0.5997 (1.0) 0.0000 (1.0) 0.5997 (1.0) 0.0000 (1.0) 0;0 1.6674 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc[2.58.2] 525.8456 (1.0) 525.8456 (1.0) 525.8456 (1.0) 0.0000 (1.0) 525.8456 (1.0) 0.0000 (1.0) 0;0 1.9017 (1.0) 1 1
test_partial_remove-gc[3.10.0] 549.1432 (1.04) 549.1432 (1.04) 549.1432 (1.04) 0.0000 (1.0) 549.1432 (1.04) 0.0000 (1.0) 0;0 1.8210 (0.96) 1 1
test_partial_remove-gc[3.53.2] 527.6000 (1.00) 527.6000 (1.00) 527.6000 (1.00) 0.0000 (1.0) 527.6000 (1.00) 0.0000 (1.0) 0;0 1.8954 (1.00) 1 1
test_partial_remove-gc[main] 532.5974 (1.01) 532.5974 (1.01) 532.5974 (1.01) 0.0000 (1.0) 532.5974 (1.01) 0.0000 (1.0) 0;0 1.8776 (0.99) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-gc-cloud': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-gc-cloud[2.58.2] 574.3047 (1.0) 574.3047 (1.0) 574.3047 (1.0) 0.0000 (1.0) 574.3047 (1.0) 0.0000 (1.0) 0;0 1.7412 (1.0) 1 1
test_partial_remove-gc-cloud[3.10.0] 595.5432 (1.04) 595.5432 (1.04) 595.5432 (1.04) 0.0000 (1.0) 595.5432 (1.04) 0.0000 (1.0) 0;0 1.6791 (0.96) 1 1
test_partial_remove-gc-cloud[3.53.2] 595.9643 (1.04) 595.9643 (1.04) 595.9643 (1.04) 0.0000 (1.0) 595.9643 (1.04) 0.0000 (1.0) 0;0 1.6780 (0.96) 1 1
test_partial_remove-gc-cloud[main] 584.1723 (1.02) 584.1723 (1.02) 584.1723 (1.02) 0.0000 (1.0) 584.1723 (1.02) 0.0000 (1.0) 0;0 1.7118 (0.98) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_partial_remove-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push[2.58.2] 2.1930 (1.64) 2.1930 (1.64) 2.1930 (1.64) 0.0000 (1.0) 2.1930 (1.64) 0.0000 (1.0) 0;0 0.4560 (0.61) 1 1
test_partial_remove-push[3.10.0] 1.9531 (1.46) 1.9531 (1.46) 1.9531 (1.46) 0.0000 (1.0) 1.9531 (1.46) 0.0000 (1.0) 0;0 0.5120 (0.69) 1 1
test_partial_remove-push[3.53.2] 1.3655 (1.02) 1.3655 (1.02) 1.3655 (1.02) 0.0000 (1.0) 1.3655 (1.02) 0.0000 (1.0) 0;0 0.7323 (0.98) 1 1
test_partial_remove-push[main] 1.3395 (1.0) 1.3395 (1.0) 1.3395 (1.0) 0.0000 (1.0) 1.3395 (1.0) 0.0000 (1.0) 0;0 0.7466 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_partial_remove-push-update': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_partial_remove-push-update[2.58.2] 501.3548 (1.01) 501.3548 (1.01) 501.3548 (1.01) 0.0000 (1.0) 501.3548 (1.01) 0.0000 (1.0) 0;0 1.9946 (0.99) 1 1
test_partial_remove-push-update[3.10.0] 496.0736 (1.0) 496.0736 (1.0) 496.0736 (1.0) 0.0000 (1.0) 496.0736 (1.0) 0.0000 (1.0) 0;0 2.0158 (1.0) 1 1
test_partial_remove-push-update[3.53.2] 770.2557 (1.55) 770.2557 (1.55) 770.2557 (1.55) 0.0000 (1.0) 770.2557 (1.55) 0.0000 (1.0) 0;0 1.2983 (0.64) 1 1
test_partial_remove-push-update[main] 823.5441 (1.66) 823.5441 (1.66) 823.5441 (1.66) 0.0000 (1.0) 823.5441 (1.66) 0.0000 (1.0) 0;0 1.2143 (0.60) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
----------------------------------------------------------------------------- benchmark 'test_plots-plots-diff': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff[2.58.2] 453.6570 (1.0) 457.4750 (1.0) 455.8640 (1.0) 1.5790 (1.0) 456.5195 (1.0) 2.4828 (1.59) 2;0 2.1936 (1.0) 5 3
test_plots-plots-diff[3.10.0] 819.8365 (1.81) 836.4518 (1.83) 825.9636 (1.81) 7.0600 (4.47) 823.0575 (1.80) 11.0544 (7.09) 1;0 1.2107 (0.55) 5 3
test_plots-plots-diff[3.53.2] 776.8374 (1.71) 791.0343 (1.73) 781.1728 (1.71) 5.6649 (3.59) 779.3234 (1.71) 5.1006 (3.27) 1;1 1.2801 (0.58) 5 3
test_plots-plots-diff[main] 790.7126 (1.74) 796.2391 (1.74) 792.8456 (1.74) 2.0386 (1.29) 792.4462 (1.74) 1.5594 (1.0) 2;1 1.2613 (0.57) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
-------------------------------------------------------------------------------- benchmark 'test_plots-plots-diff-json': 4 tests --------------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-diff-json[2.58.2] 468.4076 (1.0) 474.8381 (1.0) 472.0252 (1.0) 2.4475 (1.38) 472.5624 (1.0) 3.3303 (1.70) 2;0 2.1185 (1.0) 5 3
test_plots-plots-diff-json[3.10.0] 1,036.3423 (2.21) 1,041.1115 (2.19) 1,039.1939 (2.20) 1.7763 (1.0) 1,039.5055 (2.20) 1.9583 (1.0) 2;0 0.9623 (0.45) 5 3
test_plots-plots-diff-json[3.53.2] 845.9779 (1.81) 850.6665 (1.79) 848.1002 (1.80) 1.9883 (1.12) 847.4951 (1.79) 3.3829 (1.73) 2;0 1.1791 (0.56) 5 3
test_plots-plots-diff-json[main] 861.3925 (1.84) 879.5858 (1.85) 868.2630 (1.84) 6.7654 (3.81) 866.4019 (1.83) 5.5266 (2.82) 2;1 1.1517 (0.54) 5 3
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
----------------------------------------------------------------------------- benchmark 'test_plots-plots-show': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show[2.58.2] 417.4132 (1.0) 419.1973 (1.0) 418.3728 (1.0) 0.8303 (1.0) 418.4427 (1.0) 1.5833 (1.0) 1;0 2.3902 (1.0) 5 3
test_plots-plots-show[3.10.0] 673.4913 (1.61) 698.6927 (1.67) 683.9066 (1.63) 9.6321 (11.60) 684.7098 (1.64) 12.1069 (7.65) 2;0 1.4622 (0.61) 5 3
test_plots-plots-show[3.53.2] 657.9512 (1.58) 668.0956 (1.59) 662.1559 (1.58) 4.2327 (5.10) 660.1511 (1.58) 6.5957 (4.17) 1;0 1.5102 (0.63) 5 3
test_plots-plots-show[main] 658.8172 (1.58) 792.0502 (1.89) 689.2942 (1.65) 57.6178 (69.40) 668.0279 (1.60) 39.8622 (25.18) 1;1 1.4508 (0.61) 5 3
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_plots-plots-show-json': 4 tests -----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_plots-plots-show-json[2.58.2] 433.3633 (1.0) 438.6191 (1.0) 436.0164 (1.0) 2.0608 (1.56) 436.4876 (1.0) 3.1091 (1.29) 2;0 2.2935 (1.0) 5 3
test_plots-plots-show-json[3.10.0] 795.4813 (1.84) 807.1742 (1.84) 798.5132 (1.83) 4.8891 (3.70) 796.9982 (1.83) 3.7788 (1.57) 1;1 1.2523 (0.55) 5 3
test_plots-plots-show-json[3.53.2] 701.4336 (1.62) 704.2326 (1.61) 702.6251 (1.61) 1.3202 (1.0) 702.0316 (1.61) 2.4102 (1.0) 1;0 1.4232 (0.62) 5 3
test_plots-plots-show-json[main] 703.6669 (1.62) 718.5167 (1.64) 709.4411 (1.63) 6.5120 (4.93) 707.3677 (1.62) 11.1266 (4.62) 1;0 1.4096 (0.61) 5 3
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_push-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_push-push[2.58.2] 2.2885 (1.53) 2.2885 (1.53) 2.2885 (1.53) 0.0000 (1.0) 2.2885 (1.53) 0.0000 (1.0) 0;0 0.4370 (0.65) 1 1
test_push-push[3.10.0] 2.4608 (1.65) 2.4608 (1.65) 2.4608 (1.65) 0.0000 (1.0) 2.4608 (1.65) 0.0000 (1.0) 0;0 0.4064 (0.61) 1 1
test_push-push[3.53.2] 1.5984 (1.07) 1.5984 (1.07) 1.5984 (1.07) 0.0000 (1.0) 1.5984 (1.07) 0.0000 (1.0) 0;0 0.6256 (0.94) 1 1
test_push-push[main] 1.4950 (1.0) 1.4950 (1.0) 1.4950 (1.0) 0.0000 (1.0) 1.4950 (1.0) 0.0000 (1.0) 0;0 0.6689 (1.0) 1 1
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_sharing-fetch': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch[2.58.2] 2.6445 (1.97) 2.6445 (1.97) 2.6445 (1.97) 0.0000 (1.0) 2.6445 (1.97) 0.0000 (1.0) 0;0 0.3781 (0.51) 1 1
test_sharing-fetch[3.10.0] 2.8272 (2.11) 2.8272 (2.11) 2.8272 (2.11) 0.0000 (1.0) 2.8272 (2.11) 0.0000 (1.0) 0;0 0.3537 (0.47) 1 1
test_sharing-fetch[3.53.2] 1.6762 (1.25) 1.6762 (1.25) 1.6762 (1.25) 0.0000 (1.0) 1.6762 (1.25) 0.0000 (1.0) 0;0 0.5966 (0.80) 1 1
test_sharing-fetch[main] 1.3415 (1.0) 1.3415 (1.0) 1.3415 (1.0) 0.0000 (1.0) 1.3415 (1.0) 0.0000 (1.0) 0;0 0.7454 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-fetch-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-fetch-noop[2.58.2] 430.5144 (1.0) 430.5144 (1.0) 430.5144 (1.0) 0.0000 (1.0) 430.5144 (1.0) 0.0000 (1.0) 0;0 2.3228 (1.0) 1 1
test_sharing-fetch-noop[3.10.0] 517.2836 (1.20) 517.2836 (1.20) 517.2836 (1.20) 0.0000 (1.0) 517.2836 (1.20) 0.0000 (1.0) 0;0 1.9332 (0.83) 1 1
test_sharing-fetch-noop[3.53.2] 783.0692 (1.82) 783.0692 (1.82) 783.0692 (1.82) 0.0000 (1.0) 783.0692 (1.82) 0.0000 (1.0) 0;0 1.2770 (0.55) 1 1
test_sharing-fetch-noop[main] 791.3235 (1.84) 791.3235 (1.84) 791.3235 (1.84) 0.0000 (1.0) 791.3235 (1.84) 0.0000 (1.0) 0;0 1.2637 (0.54) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_sharing-push': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push[2.58.2] 2.2273 (1.54) 2.2273 (1.54) 2.2273 (1.54) 0.0000 (1.0) 2.2273 (1.54) 0.0000 (1.0) 0;0 0.4490 (0.65) 1 1
test_sharing-push[3.10.0] 2.1058 (1.46) 2.1058 (1.46) 2.1058 (1.46) 0.0000 (1.0) 2.1058 (1.46) 0.0000 (1.0) 0;0 0.4749 (0.69) 1 1
test_sharing-push[3.53.2] 1.5459 (1.07) 1.5459 (1.07) 1.5459 (1.07) 0.0000 (1.0) 1.5459 (1.07) 0.0000 (1.0) 0;0 0.6469 (0.94) 1 1
test_sharing-push[main] 1.4469 (1.0) 1.4469 (1.0) 1.4469 (1.0) 0.0000 (1.0) 1.4469 (1.0) 0.0000 (1.0) 0;0 0.6911 (1.0) 1 1
----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_sharing-push-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_sharing-push-noop[2.58.2] 511.1376 (1.14) 511.1376 (1.14) 511.1376 (1.14) 0.0000 (1.0) 511.1376 (1.14) 0.0000 (1.0) 0;0 1.9564 (0.88) 1 1
test_sharing-push-noop[3.10.0] 447.4521 (1.0) 447.4521 (1.0) 447.4521 (1.0) 0.0000 (1.0) 447.4521 (1.0) 0.0000 (1.0) 0;0 2.2349 (1.0) 1 1
test_sharing-push-noop[3.53.2] 770.7705 (1.72) 770.7705 (1.72) 770.7705 (1.72) 0.0000 (1.0) 770.7705 (1.72) 0.0000 (1.0) 0;0 1.2974 (0.58) 1 1
test_sharing-push-noop[main] 792.0099 (1.77) 792.0099 (1.77) 792.0099 (1.77) 0.0000 (1.0) 792.0099 (1.77) 0.0000 (1.0) 0;0 1.2626 (0.56) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_status-status': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status[2.58.2] 1.3284 (1.60) 1.3284 (1.60) 1.3284 (1.60) 0.0000 (1.0) 1.3284 (1.60) 0.0000 (1.0) 0;0 0.7528 (0.63) 1 1
test_status-status[3.10.0] 1.4229 (1.71) 1.4229 (1.71) 1.4229 (1.71) 0.0000 (1.0) 1.4229 (1.71) 0.0000 (1.0) 0;0 0.7028 (0.58) 1 1
test_status-status[3.53.2] 1.3221 (1.59) 1.3221 (1.59) 1.3221 (1.59) 0.0000 (1.0) 1.3221 (1.59) 0.0000 (1.0) 0;0 0.7563 (0.63) 1 1
test_status-status[main] 0.8305 (1.0) 0.8305 (1.0) 0.8305 (1.0) 0.0000 (1.0) 0.8305 (1.0) 0.0000 (1.0) 0;0 1.2040 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed[2.58.2] 561.9051 (1.20) 561.9051 (1.20) 561.9051 (1.20) 0.0000 (1.0) 561.9051 (1.20) 0.0000 (1.0) 0;0 1.7797 (0.83) 1 1
test_status-status-changed[3.10.0] 551.7242 (1.18) 551.7242 (1.18) 551.7242 (1.18) 0.0000 (1.0) 551.7242 (1.18) 0.0000 (1.0) 0;0 1.8125 (0.85) 1 1
test_status-status-changed[3.53.2] 546.1929 (1.17) 546.1929 (1.17) 546.1929 (1.17) 0.0000 (1.0) 546.1929 (1.17) 0.0000 (1.0) 0;0 1.8309 (0.86) 1 1
test_status-status-changed[main] 468.5449 (1.0) 468.5449 (1.0) 468.5449 (1.0) 0.0000 (1.0) 468.5449 (1.0) 0.0000 (1.0) 0;0 2.1343 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-changed-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-changed-noop[2.58.2] 562.5752 (1.23) 562.5752 (1.23) 562.5752 (1.23) 0.0000 (1.0) 562.5752 (1.23) 0.0000 (1.0) 0;0 1.7775 (0.81) 1 1
test_status-status-changed-noop[3.10.0] 559.0451 (1.22) 559.0451 (1.22) 559.0451 (1.22) 0.0000 (1.0) 559.0451 (1.22) 0.0000 (1.0) 0;0 1.7888 (0.82) 1 1
test_status-status-changed-noop[3.53.2] 527.5252 (1.15) 527.5252 (1.15) 527.5252 (1.15) 0.0000 (1.0) 527.5252 (1.15) 0.0000 (1.0) 0;0 1.8956 (0.87) 1 1
test_status-status-changed-noop[main] 457.7524 (1.0) 457.7524 (1.0) 457.7524 (1.0) 0.0000 (1.0) 457.7524 (1.0) 0.0000 (1.0) 0;0 2.1846 (1.0) 1 1
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_status-status-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_status-status-noop[2.58.2] 546.1071 (1.19) 546.1071 (1.19) 546.1071 (1.19) 0.0000 (1.0) 546.1071 (1.19) 0.0000 (1.0) 0;0 1.8311 (0.84) 1 1
test_status-status-noop[3.10.0] 549.2482 (1.20) 549.2482 (1.20) 549.2482 (1.20) 0.0000 (1.0) 549.2482 (1.20) 0.0000 (1.0) 0;0 1.8207 (0.83) 1 1
test_status-status-noop[3.53.2] 528.7952 (1.16) 528.7952 (1.16) 528.7952 (1.16) 0.0000 (1.0) 528.7952 (1.16) 0.0000 (1.0) 0;0 1.8911 (0.86) 1 1
test_status-status-noop[main] 457.2891 (1.0) 457.2891 (1.0) 457.2891 (1.0) 0.0000 (1.0) 457.2891 (1.0) 0.0000 (1.0) 0;0 2.1868 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
------------------------------------------------------------------------ benchmark 'test_update-import-url': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-import-url[2.58.2] 6.0770 (2.16) 6.0770 (2.16) 6.0770 (2.16) 0.0000 (1.0) 6.0770 (2.16) 0.0000 (1.0) 0;0 0.1646 (0.46) 1 1
test_update-import-url[3.10.0] 6.1860 (2.20) 6.1860 (2.20) 6.1860 (2.20) 0.0000 (1.0) 6.1860 (2.20) 0.0000 (1.0) 0;0 0.1617 (0.45) 1 1
test_update-import-url[3.53.2] 4.6501 (1.66) 4.6501 (1.66) 4.6501 (1.66) 0.0000 (1.0) 4.6501 (1.66) 0.0000 (1.0) 0;0 0.2150 (0.60) 1 1
test_update-import-url[main] 2.8090 (1.0) 2.8090 (1.0) 2.8090 (1.0) 0.0000 (1.0) 2.8090 (1.0) 0.0000 (1.0) 0;0 0.3560 (1.0) 1 1
---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
------------------------------------------------------------------------ benchmark 'test_update-update': 4 tests ------------------------------------------------------------------------
Name (time in s) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update[2.58.2] 5.1705 (3.10) 5.1705 (3.10) 5.1705 (3.10) 0.0000 (1.0) 5.1705 (3.10) 0.0000 (1.0) 0;0 0.1934 (0.32) 1 1
test_update-update[3.10.0] 5.0479 (3.02) 5.0479 (3.02) 5.0479 (3.02) 0.0000 (1.0) 5.0479 (3.02) 0.0000 (1.0) 0;0 0.1981 (0.33) 1 1
test_update-update[3.53.2] 3.9653 (2.38) 3.9653 (2.38) 3.9653 (2.38) 0.0000 (1.0) 3.9653 (2.38) 0.0000 (1.0) 0;0 0.2522 (0.42) 1 1
test_update-update[main] 1.6693 (1.0) 1.6693 (1.0) 1.6693 (1.0) 0.0000 (1.0) 1.6693 (1.0) 0.0000 (1.0) 0;0 0.5991 (1.0) 1 1
-----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
---------------------------------------------------------------------------- benchmark 'test_update-update-noop': 4 tests ----------------------------------------------------------------------------
Name (time in ms) Min Max Mean StdDev Median IQR Outliers OPS Rounds Iterations
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
test_update-update-noop[2.58.2] 960.8596 (1.58) 960.8596 (1.58) 960.8596 (1.58) 0.0000 (1.0) 960.8596 (1.58) 0.0000 (1.0) 0;0 1.0407 (0.63) 1 1
test_update-update-noop[3.10.0] 925.9353 (1.52) 925.9353 (1.52) 925.9353 (1.52) 0.0000 (1.0) 925.9353 (1.52) 0.0000 (1.0) 0;0 1.0800 (0.66) 1 1
test_update-update-noop[3.53.2] 887.1460 (1.46) 887.1460 (1.46) 887.1460 (1.46) 0.0000 (1.0) 887.1460 (1.46) 0.0000 (1.0) 0;0 1.1272 (0.69) 1 1
test_update-update-noop[main] 609.4005 (1.0) 609.4005 (1.0) 609.4005 (1.0) 0.0000 (1.0) 609.4005 (1.0) 0.0000 (1.0) 0;0 1.6410 (1.0) 1 1
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Legend:
Outliers: 1 Standard Deviation from Mean; 1.5 IQR (InterQuartile Range) from 1st Quartile and 3rd Quartile.
OPS: Operations Per Second, computed as 1 / Mean
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}