Operation tool
Closes #
Performance Benchmark Results
🔧 Graph Compilation
compile_demo_art_iai::compile_group::compile_to_proto with_setup_0:load_from_name(isometric-fountain)
Instructions: 22,907,584 (master) → 27,729,061 (HEAD) : $$\color{red}+21.05\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 287,862| 356,302 +23.78%
D1mw 79,275| 118,802 +49.86%
DLmr 28,573| 37,418 +30.96%
DLmw 42,143| 53,573 +27.12%
Dr 5,686,132| 6,727,491 +18.31%
Dw 3,956,663| 4,755,692 +20.19%
EstimatedCycles 36,392,455| 44,078,388 +21.12%
I1mr 56,757| 52,482 -7.53%
ILmr 834| 869 +4.20%
Ir 22,907,584| 27,729,061 +21.05%
L1hits 32,126,485| 38,684,658 +20.41%
LLhits 352,344| 435,726 +23.66%
RamHits 71,550| 91,860 +28.39%
TotalRW 32,550,379| 39,212,244 +20.47%
compile_demo_art_iai::compile_group::compile_to_proto with_setup_1:load_from_name(painted-dreams)
Instructions: 12,179,519 (master) → 14,893,523 (HEAD) : $$\color{red}+22.28\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 146,503| 184,309 +25.81%
D1mw 41,629| 62,400 +49.90%
DLmr 696| 1,596 +129.31%
DLmw 14,051| 17,321 +23.27%
Dr 3,009,783| 3,583,555 +19.06%
Dw 2,094,122| 2,534,288 +21.02%
EstimatedCycles 18,610,874| 22,689,340 +21.91%
I1mr 27,983| 25,357 -9.38%
ILmr 686| 740 +7.87%
Ir 12,179,519| 14,893,523 +22.28%
L1hits 17,067,309| 20,739,300 +21.51%
LLhits 200,682| 252,409 +25.78%
RamHits 15,433| 19,657 +27.37%
TotalRW 17,283,424| 21,011,366 +21.57%
compile_demo_art_iai::compile_group::compile_to_proto with_setup_2:load_from_name(procedural-string-lights)
Instructions: 2,596,571 (master) → 3,131,908 (HEAD) : $$\color{red}+20.62\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 30,961| 37,800 +22.09%
D1mw 7,836| 11,812 +50.74%
DLmr 15| 20 +33.33%
DLmw 2,807| 3,236 +15.28%
Dr 634,925| 750,369 +18.18%
Dw 441,847| 529,689 +19.88%
EstimatedCycles 3,956,117| 4,751,282 +20.10%
I1mr 5,729| 5,427 -5.27%
ILmr 667| 716 +7.35%
Ir 2,596,571| 3,131,908 +20.62%
L1hits 3,628,817| 4,356,927 +20.06%
LLhits 41,037| 51,067 +24.44%
RamHits 3,489| 3,972 +13.84%
TotalRW 3,673,343| 4,411,966 +20.11%
compile_demo_art_iai::compile_group::compile_to_proto with_setup_3:load_from_name(parametric-dunescape)
Instructions: 12,307,737 (master) → 14,969,129 (HEAD) : $$\color{red}+21.62\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 160,656| 196,357 +22.22%
D1mw 44,776| 68,240 +52.40%
DLmr 81| 135 +66.67%
DLmw 14,782| 14,568 -1.45%
Dr 3,012,170| 3,600,805 +19.54%
Dw 2,119,905| 2,572,477 +21.35%
EstimatedCycles 18,819,222| 22,749,783 +20.89%
I1mr 22,068| 20,546 -6.90%
ILmr 784| 857 +9.31%
Ir 12,307,737| 14,969,129 +21.62%
L1hits 17,212,312| 20,857,268 +21.18%
LLhits 211,853| 269,583 +27.25%
RamHits 15,647| 15,560 -0.56%
TotalRW 17,439,812| 21,142,411 +21.23%
compile_demo_art_iai::compile_group::compile_to_proto with_setup_4:load_from_name(red-dress)
Instructions: 27,609,611 (master) → 33,720,412 (HEAD) : $$\color{red}+22.13\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 348,406| 435,341 +24.95%
D1mw 93,021| 140,648 +51.20%
DLmr 42,555| 53,068 +24.70%
DLmw 61,169| 60,860 -0.51%
Dr 6,824,583| 8,122,107 +19.01%
Dw 4,753,281| 5,754,614 +21.07%
EstimatedCycles 44,341,537| 53,575,675 +20.83%
I1mr 63,016| 57,669 -8.49%
ILmr 819| 869 +6.11%
Ir 27,609,611| 33,720,412 +22.13%
L1hits 38,683,032| 46,963,475 +21.41%
LLhits 399,900| 518,861 +29.75%
RamHits 104,543| 114,797 +9.81%
TotalRW 39,187,475| 47,597,133 +21.46%
compile_demo_art_iai::compile_group::compile_to_proto with_setup_5:load_from_name(valley-of-spires)
Instructions: 17,589,534 (master) → 21,406,461 (HEAD) : $$\color{red}+21.70\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 215,401| 269,670 +25.19%
D1mw 55,203| 84,954 +53.89%
DLmr 13,857| 19,697 +42.14%
DLmw 29,597| 33,857 +14.39%
Dr 4,369,475| 5,185,217 +18.67%
Dw 3,034,984| 3,662,353 +20.67%
EstimatedCycles 27,573,659| 33,460,981 +21.35%
I1mr 42,670| 39,331 -7.83%
ILmr 765| 817 +6.80%
Ir 17,589,534| 21,406,461 +21.70%
L1hits 24,680,719| 29,860,076 +20.99%
LLhits 269,055| 339,584 +26.21%
RamHits 44,219| 54,371 +22.96%
TotalRW 24,993,993| 30,254,031 +21.05%
🔄 Executor Update
update_executor_iai::update_group::update_executor with_setup_0:setup_update_executor(isometric-fountain)
Instructions: 41,147,967 (master) → 42,002,329 (HEAD) : $$\color{red}+2.08\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 452,565| 475,985 +5.17%
D1mw 98,213| 106,992 +8.94%
DLmr 7,865| 18,855 +139.73%
DLmw 28,371| 23,999 -15.41%
Dr 10,446,976| 10,659,442 +2.03%
Dw 7,063,216| 7,218,261 +2.20%
EstimatedCycles 62,096,001| 63,643,058 +2.49%
I1mr 35,165| 34,522 -1.83%
ILmr 233| 247 +6.01%
Ir 41,147,967| 42,002,329 +2.08%
L1hits 58,072,216| 59,262,533 +2.05%
LLhits 549,474| 574,398 +4.54%
RamHits 36,469| 43,101 +18.19%
TotalRW 58,658,159| 59,880,032 +2.08%
update_executor_iai::update_group::update_executor with_setup_1:setup_update_executor(painted-dreams)
Instructions: 22,785,118 (master) → 23,081,259 (HEAD) : $$\color{red}+1.30\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 238,273| 243,370 +2.14%
D1mw 52,554| 55,514 +5.63%
DLmr 1,025| 421 -58.93%
DLmw 11,327| 8,504 -24.92%
Dr 5,746,746| 5,820,261 +1.28%
Dw 3,907,483| 3,957,989 +1.29%
EstimatedCycles 34,066,303| 34,394,985 +0.96%
I1mr 21,727| 16,660 -23.32%
ILmr 206| 185 -10.19%
Ir 22,785,118| 23,081,259 +1.30%
L1hits 32,126,793| 32,543,965 +1.30%
LLhits 299,996| 306,434 +2.15%
RamHits 12,558| 9,110 -27.46%
TotalRW 32,439,347| 32,859,509 +1.30%
update_executor_iai::update_group::update_executor with_setup_2:setup_update_executor(procedural-string-lights)
Instructions: 4,733,916 (master) → 4,860,194 (HEAD) : $$\color{red}+2.67\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 45,251| 48,348 +6.84%
D1mw 11,401| 12,703 +11.42%
DLmr 2| 0 -100.00%
DLmw 586| 756 +29.01%
Dr 1,191,141| 1,221,448 +2.54%
Dw 810,207| 831,823 +2.67%
EstimatedCycles 7,006,536| 7,210,203 +2.91%
I1mr 5,241| 6,166 +17.65%
ILmr 202| 173 -14.36%
Ir 4,733,916| 4,860,194 +2.67%
L1hits 6,673,371| 6,846,248 +2.59%
LLhits 61,103| 66,288 +8.49%
RamHits 790| 929 +17.59%
TotalRW 6,735,264| 6,913,465 +2.65%
update_executor_iai::update_group::update_executor with_setup_3:setup_update_executor(parametric-dunescape)
Instructions: 18,948,091 (master) → 18,963,367 (HEAD) : $$\color{red}+0.08\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 186,718| 186,465 -0.14%
D1mw 46,548| 47,509 +2.06%
DLmr 146| 30 -79.45%
DLmw 6,687| 4,515 -32.48%
Dr 4,732,774| 4,760,514 +0.59%
Dw 3,247,856| 3,278,373 +0.94%
EstimatedCycles 28,130,851| 28,128,568 -0.01%
I1mr 14,639| 12,122 -17.19%
ILmr 184| 186 +1.09%
Ir 18,948,091| 18,963,367 +0.08%
L1hits 26,680,816| 26,756,158 +0.28%
LLhits 240,888| 241,365 +0.20%
RamHits 7,017| 4,731 -32.58%
TotalRW 26,928,721| 27,002,254 +0.27%
update_executor_iai::update_group::update_executor with_setup_4:setup_update_executor(red-dress)
Instructions: 51,136,009 (master) → 51,950,392 (HEAD) : $$\color{red}+1.59\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 546,574| 574,627 +5.13%
D1mw 124,915| 134,697 +7.83%
DLmr 17,934| 34,022 +89.71%
DLmw 46,857| 45,674 -2.52%
Dr 13,106,293| 13,319,126 +1.62%
Dw 8,980,047| 9,128,318 +1.65%
EstimatedCycles 78,018,295| 79,789,646 +2.27%
I1mr 39,495| 37,586 -4.83%
ILmr 276| 443 +60.51%
Ir 51,136,009| 51,950,392 +1.59%
L1hits 72,511,365| 73,650,926 +1.57%
LLhits 645,917| 666,771 +3.23%
RamHits 65,067| 80,139 +23.16%
TotalRW 73,222,349| 74,397,836 +1.61%
update_executor_iai::update_group::update_executor with_setup_5:setup_update_executor(valley-of-spires)
Instructions: 32,769,161 (master) → 33,388,786 (HEAD) : $$\color{red}+1.89\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 360,528| 377,074 +4.59%
D1mw 78,421| 87,017 +10.96%
DLmr 3,831| 9,269 +141.95%
DLmw 20,398| 19,063 -6.54%
Dr 8,333,086| 8,465,414 +1.59%
Dw 5,652,630| 5,742,936 +1.60%
EstimatedCycles 49,353,531| 50,412,902 +2.15%
I1mr 27,362| 25,853 -5.51%
ILmr 218| 201 -7.80%
Ir 32,769,161| 33,388,786 +1.89%
L1hits 46,288,566| 47,107,192 +1.77%
LLhits 441,864| 461,411 +4.42%
RamHits 24,447| 28,533 +16.71%
TotalRW 46,754,877| 47,597,136 +1.80%
🚀 Render: Cold Execution
run_once_iai::run_once_group::run_once with_setup_0:setup_run_once(isometric-fountain)
Instructions: 20,721,867 (master) → 20,639,885 (HEAD) : $$\color{lime}-0.40\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 235,911| 235,651 -0.11%
D1mw 50,205| 50,552 +0.69%
DLmr 8,543| 3,418 -59.99%
DLmw 15,421| 13,436 -12.87%
Dr 5,278,452| 5,251,683 -0.51%
Dw 3,528,769| 3,521,630 -0.20%
EstimatedCycles 31,994,418| 31,654,470 -1.06%
I1mr 114,674| 111,980 -2.35%
ILmr 4,775| 4,764 -0.23%
Ir 20,721,867| 20,639,885 -0.40%
L1hits 29,128,298| 29,015,015 -0.39%
LLhits 372,051| 376,565 +1.21%
RamHits 28,739| 21,618 -24.78%
TotalRW 29,529,088| 29,413,198 -0.39%
run_once_iai::run_once_group::run_once with_setup_1:setup_run_once(painted-dreams)
Instructions: 76,717,903 (master) → 76,768,272 (HEAD) : $$\color{red}+0.07\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 386,063| 385,072 -0.26%
D1mw 179,899| 181,394 +0.83%
DLmr 5,104| 4,681 -8.29%
DLmw 47,292| 53,790 +13.74%
Dr 18,111,060| 18,175,610 +0.36%
Dw 12,129,142| 12,200,199 +0.59%
EstimatedCycles 111,622,129|111,989,211 +0.33%
I1mr 154,274| 154,189 -0.06%
ILmr 7,040| 6,946 -1.34%
Ir 76,717,903| 76,768,272 +0.07%
L1hits 106,237,869|106,423,426 +0.17%
LLhits 660,800| 655,238 -0.84%
RamHits 59,436| 65,417 +10.06%
TotalRW 106,958,105|107,144,081 +0.17%
run_once_iai::run_once_group::run_once with_setup_2:setup_run_once(procedural-string-lights)
Instructions: 9,743,636 (master) → 9,662,633 (HEAD) : $$\color{lime}-0.83\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 44,214| 41,868 -5.31%
D1mw 16,405| 17,205 +4.88%
DLmr 235| 234 -0.43%
DLmw 3,476| 3,993 +14.87%
Dr 2,231,872| 2,228,020 -0.17%
Dw 1,545,248| 1,556,435 +0.72%
EstimatedCycles 14,135,396| 14,057,212 -0.55%
I1mr 34,511| 32,063 -7.09%
ILmr 4,093| 3,959 -3.27%
Ir 9,743,636| 9,662,633 -0.83%
L1hits 13,425,626| 13,355,952 -0.52%
LLhits 87,326| 82,950 -5.01%
RamHits 7,804| 8,186 +4.89%
TotalRW 13,520,756| 13,447,088 -0.54%
run_once_iai::run_once_group::run_once with_setup_3:setup_run_once(parametric-dunescape)
Instructions: 26,335,477 (master) → 26,370,488 (HEAD) : $$\color{red}+0.13\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 121,243| 118,912 -1.92%
D1mw 50,789| 52,262 +2.90%
DLmr 1,607| 532 -66.89%
DLmw 10,408| 8,605 -17.32%
Dr 5,862,367| 5,882,655 +0.35%
Dw 3,492,502| 3,516,988 +0.70%
EstimatedCycles 37,085,758| 37,078,329 -0.02%
I1mr 61,981| 62,688 +1.14%
ILmr 3,297| 3,288 -0.27%
Ir 26,335,477| 26,370,488 +0.13%
L1hits 35,456,333| 35,536,269 +0.23%
LLhits 218,701| 221,437 +1.25%
RamHits 15,312| 12,425 -18.85%
TotalRW 35,690,346| 35,770,131 +0.22%
run_once_iai::run_once_group::run_once with_setup_4:setup_run_once(red-dress)
Instructions: 1,884,670,026 (master) → 1,884,278,040 (HEAD) : $$\color{lime}-0.02\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 1,516,091| 1,517,989 +0.13%
D1mw 689,649| 691,534 +0.27%
DLmr 320,325| 314,122 -1.94%
DLmw 456,729| 425,061 -6.93%
Dr 437,482,680|436,984,756 -0.11%
Dw 279,310,107|278,763,205 -0.20%
EstimatedCycles 2,636,699,601|2,633,716,095 -0.11%
I1mr 737,287| 631,208 -14.39%
ILmr 5,102| 5,056 -0.90%
Ir 1,884,670,026|1,884,278,040 -0.02%
L1hits 2,598,519,786|2,597,185,270 -0.05%
LLhits 2,160,871| 2,096,492 -2.98%
RamHits 782,156| 744,239 -4.85%
TotalRW 2,601,462,813|2,600,026,001 -0.06%
run_once_iai::run_once_group::run_once with_setup_5:setup_run_once(valley-of-spires)
Instructions: 19,135,242 (master) → 19,036,623 (HEAD) : $$\color{lime}-0.52\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 191,288| 190,372 -0.48%
D1mw 44,027| 42,589 -3.27%
DLmr 5,553| 618 -88.87%
DLmw 12,199| 9,891 -18.92%
Dr 4,661,175| 4,633,879 -0.59%
Dw 3,085,438| 3,078,642 -0.22%
EstimatedCycles 28,816,749| 28,446,638 -1.28%
I1mr 92,476| 89,915 -2.77%
ILmr 3,039| 3,024 -0.49%
Ir 19,135,242| 19,036,623 -0.52%
L1hits 26,554,064| 26,426,268 -0.48%
LLhits 307,000| 309,343 +0.76%
RamHits 20,791| 13,533 -34.91%
TotalRW 26,881,855| 26,749,144 -0.49%
⚡ Render: Cached Execution
run_cached_iai::run_cached_group::run_cached with_setup_0:setup_run_cached(isometric-fountain)
Instructions: 20,829,356 (master) → 20,767,739 (HEAD) : $$\color{lime}-0.30\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 253,382| 252,565 -0.32%
D1mw 45,262| 45,451 +0.42%
DLmr 2,129| 2,766 +29.92%
DLmw 585| 614 +4.96%
Dr 5,377,169| 5,346,109 -0.58%
Dw 3,558,767| 3,553,678 -0.14%
EstimatedCycles 31,503,734| 31,409,112 -0.30%
I1mr 114,464| 111,003 -3.02%
ILmr 153| 137 -10.46%
Ir 20,829,356| 20,767,739 -0.30%
L1hits 29,352,184| 29,258,507 -0.32%
LLhits 410,241| 405,502 -1.16%
RamHits 2,867| 3,517 +22.67%
TotalRW 29,765,292| 29,667,526 -0.33%
run_cached_iai::run_cached_group::run_cached with_setup_1:setup_run_cached(painted-dreams)
Instructions: 26,369,805 (master) → 26,356,614 (HEAD) : $$\color{lime}-0.05\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 219,907| 214,839 -2.30%
D1mw 54,528| 54,059 -0.86%
DLmr 898| 3,660 +307.57%
DLmw 501| 1,570 +213.37%
Dr 6,502,626| 6,485,686 -0.26%
Dw 4,440,336| 4,432,249 -0.18%
EstimatedCycles 38,741,355| 38,778,683 +0.10%
I1mr 71,057| 66,898 -5.85%
ILmr 155| 135 -12.90%
Ir 26,369,805| 26,356,614 -0.05%
L1hits 36,967,275| 36,938,753 -0.08%
LLhits 343,938| 330,431 -3.93%
RamHits 1,554| 5,365 +245.24%
TotalRW 37,312,767| 37,274,549 -0.10%
run_cached_iai::run_cached_group::run_cached with_setup_2:setup_run_cached(procedural-string-lights)
Instructions: 9,179,311 (master) → 9,223,570 (HEAD) : $$\color{red}+0.48\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 47,193| 48,939 +3.70%
D1mw 15,069| 15,630 +3.72%
DLmr 9| 5 -44.44%
DLmw 124| 118 -4.84%
Dr 2,159,198| 2,187,590 +1.31%
Dw 1,512,974| 1,544,787 +2.10%
EstimatedCycles 13,237,025| 13,339,123 +0.77%
I1mr 31,971| 29,380 -8.10%
ILmr 154| 123 -20.13%
Ir 9,179,311| 9,223,570 +0.48%
L1hits 12,757,250| 12,861,998 +0.82%
LLhits 93,946| 93,703 -0.26%
RamHits 287| 246 -14.29%
TotalRW 12,851,483| 12,955,947 +0.81%
run_cached_iai::run_cached_group::run_cached with_setup_3:setup_run_cached(parametric-dunescape)
Instructions: 16,245,834 (master) → 16,116,732 (HEAD) : $$\color{lime}-0.79\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 105,945| 102,960 -2.82%
D1mw 37,733| 36,196 -4.07%
DLmr 43| 11 -74.42%
DLmw 1,124| 517 -54.00%
Dr 3,711,520| 3,640,106 -1.92%
Dw 2,474,247| 2,412,763 -2.48%
EstimatedCycles 23,146,349| 22,848,717 -1.29%
I1mr 25,394| 25,853 +1.81%
ILmr 115| 108 -6.09%
Ir 16,245,834| 16,116,732 -0.79%
L1hits 22,262,529| 22,004,592 -1.16%
LLhits 167,790| 164,373 -2.04%
RamHits 1,282| 636 -50.39%
TotalRW 22,431,601| 22,169,601 -1.17%
run_cached_iai::run_cached_group::run_cached with_setup_4:setup_run_cached(red-dress)
Instructions: 280,256,063 (master) → 279,821,187 (HEAD) : $$\color{lime}-0.16\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 1,426,150| 1,413,504 -0.89%
D1mw 460,866| 456,876 -0.87%
DLmr 494,054| 469,914 -4.89%
DLmw 230,939| 203,583 -11.85%
Dr 68,177,268| 67,874,386 -0.44%
Dw 48,999,472| 48,644,415 -0.72%
EstimatedCycles 429,454,047|426,414,552 -0.71%
I1mr 651,335| 567,266 -12.91%
ILmr 3,935| 3,969 +0.86%
Ir 280,256,063|279,821,187 -0.16%
L1hits 394,894,452|393,902,342 -0.25%
LLhits 1,809,423| 1,760,180 -2.72%
RamHits 728,928| 677,466 -7.06%
TotalRW 397,432,803|396,339,988 -0.27%
run_cached_iai::run_cached_group::run_cached with_setup_5:setup_run_cached(valley-of-spires)
Instructions: 19,393,660 (master) → 19,313,105 (HEAD) : $$\color{lime}-0.42\%$$
Detailed metrics
Baselines: master| HEAD
D1mr 207,672| 207,176 -0.24%
D1mw 39,851| 40,125 +0.69%
DLmr 233| 138 -40.77%
DLmw 1,032| 940 -8.91%
Dr 4,778,903| 4,762,300 -0.35%
Dw 3,129,338| 3,136,122 +0.22%
EstimatedCycles 28,715,251| 28,606,475 -0.38%
I1mr 95,247| 92,421 -2.97%
ILmr 144| 124 -13.89%
Ir 19,393,660| 19,313,105 -0.42%
L1hits 26,959,131| 26,871,805 -0.32%
LLhits 341,361| 338,520 -0.83%
RamHits 1,409| 1,202 -14.69%
TotalRW 27,301,901| 27,211,527 -0.33%
profiling CI is fixed once https://github.com/GraphiteEditor/Graphite/pull/3101 is merged