preact icon indicating copy to clipboard operation
preact copied to clipboard

[draft] Restructure, VM edition

Open developit opened this issue 2 years ago • 2 comments

Wanted to check benchmarks so far.

developit avatar Aug 08 '21 22:08 developit

📊 Tachometer Benchmark Results

Summary

duration

  • 02_replace1k: slower ❌ 7% - 14% (8.29ms - 16.31ms)
    preact-local vs preact-master
  • 03_update10th1k_x16: slower ❌ 289% - 312% (268.84ms - 288.72ms)
    preact-local vs preact-master
  • 07_create10k: slower ❌ 10% - 12% (177.39ms - 203.72ms)
    preact-local vs preact-master
  • filter_list: faster ✔ 39% - 41% (68.59ms - 71.39ms)
    preact-local vs preact-master
  • many_updates: slower ❌ 165% - 189% (182.15ms - 206.56ms)
    preact-local vs preact-master
  • text_update: slower ❌ 12% - 15% (9.34ms - 11.17ms)
    preact-local vs preact-master
  • todo: faster ✔ 19% - 23% (11.69ms - 14.49ms)
    preact-local vs preact-master

usedJSHeapSize

  • 02_replace1k: faster ✔ 3% - 4% (0.13ms - 0.13ms)
    preact-local vs preact-master
  • 03_update10th1k_x16: faster ✔ 13% - 13% (0.48ms - 0.49ms)
    preact-local vs preact-master
  • 07_create10k: faster ✔ 20% - 20% (5.35ms - 5.35ms)
    preact-local vs preact-master
  • filter_list: faster ✔ 13% - 15% (0.23ms - 0.27ms)
    preact-local vs preact-master
  • many_updates: faster ✔ 17% - 17% (0.93ms - 0.93ms)
    preact-local vs preact-master
  • text_update: faster ✔ 4% - 6% (0.04ms - 0.06ms)
    preact-local vs preact-master
  • todo: faster ✔ 5% - 9% (0.05ms - 0.10ms)
    preact-local vs preact-master

Results

02_replace1k
  • Browser: chrome-headless 92.0.4515.131
  • Sample size: 80
  • Built by: Benchmarks #434
  • Commit: 5ace860

duration

VersionAvg timevs preact-mastervs preact-local
preact-master112.38ms - 113.88ms-faster ✔
7% - 13%
8.29ms - 16.31ms
preact-local121.49ms - 129.36msslower ❌
7% - 14%
8.29ms - 16.31ms
-

usedJSHeapSize

VersionAvg timevs preact-mastervs preact-local
preact-master3.76ms - 3.76ms-slower ❌
3% - 4%
0.13ms - 0.13ms
preact-local3.63ms - 3.63msfaster ✔
3% - 4%
0.13ms - 0.13ms
-

run-warmup-0

VersionAvg timevs preact-mastervs preact-local
preact-master52.79ms - 53.82ms-faster ✔
22% - 24%
15.48ms - 16.58ms
preact-local69.14ms - 69.52msslower ❌
29% - 31%
15.48ms - 16.58ms
-

run-warmup-1

VersionAvg timevs preact-mastervs preact-local
preact-master70.92ms - 71.95ms-faster ✔
18% - 20%
16.17ms - 17.54ms
preact-local87.83ms - 88.75msslower ❌
22% - 25%
16.17ms - 17.54ms
-

run-warmup-2

VersionAvg timevs preact-mastervs preact-local
preact-master61.08ms - 61.93ms-faster ✔
27% - 28%
22.83ms - 24.28ms
preact-local84.48ms - 85.65msslower ❌
37% - 40%
22.83ms - 24.28ms
-

run-warmup-3

VersionAvg timevs preact-mastervs preact-local
preact-master49.13ms - 49.64ms-faster ✔
12% - 22%
6.53ms - 13.97ms
preact-local55.93ms - 63.35msslower ❌
13% - 28%
6.53ms - 13.97ms
-

run-warmup-4

VersionAvg timevs preact-mastervs preact-local
preact-master60.78ms - 62.13ms-faster ✔
8% - 21%
5.08ms - 16.32ms
preact-local66.58ms - 77.73msslower ❌
8% - 27%
5.08ms - 16.32ms
-

run-final

VersionAvg timevs preact-mastervs preact-local
preact-master112.41ms - 113.91ms-faster ✔
7% - 13%
8.29ms - 16.31ms
preact-local121.52ms - 129.40msslower ❌
7% - 14%
8.29ms - 16.31ms
-
03_update10th1k_x16
  • Browser: chrome-headless 92.0.4515.131
  • Sample size: 50
  • Built by: Benchmarks #434
  • Commit: 5ace860

duration

VersionAvg timevs preact-mastervs preact-local
preact-master91.64ms - 93.79ms-faster ✔
74% - 76%
268.84ms - 288.72ms
preact-local361.61ms - 381.37msslower ❌
289% - 312%
268.84ms - 288.72ms
-

usedJSHeapSize

VersionAvg timevs preact-mastervs preact-local
preact-master3.73ms - 3.73ms-slower ❌
15% - 15%
0.48ms - 0.49ms
preact-local3.24ms - 3.25msfaster ✔
13% - 13%
0.48ms - 0.49ms
-
07_create10k
  • Browser: chrome-headless 92.0.4515.131
  • Sample size: 50
  • Built by: Benchmarks #434
  • Commit: 5ace860

duration

VersionAvg timevs preact-mastervs preact-local
preact-master1743.81ms - 1763.55ms-faster ✔
9% - 10%
177.39ms - 203.72ms
preact-local1935.52ms - 1952.95msslower ❌
10% - 12%
177.39ms - 203.72ms
-

usedJSHeapSize

VersionAvg timevs preact-mastervs preact-local
preact-master27.30ms - 27.30ms-slower ❌
24% - 24%
5.35ms - 5.35ms
preact-local21.94ms - 21.94msfaster ✔
20% - 20%
5.35ms - 5.35ms
-
filter_list
  • Browser: chrome-headless 92.0.4515.131
  • Sample size: 50
  • Built by: Benchmarks #434
  • Commit: 5ace860

duration

VersionAvg timevs preact-mastervs preact-local
preact-master173.72ms - 176.34ms-slower ❌
65% - 68%
68.59ms - 71.39ms
preact-local104.54ms - 105.54msfaster ✔
39% - 41%
68.59ms - 71.39ms
-

usedJSHeapSize

VersionAvg timevs preact-mastervs preact-local
preact-master1.76ms - 1.80ms-slower ❌
15% - 18%
0.23ms - 0.27ms
preact-local1.52ms - 1.54msfaster ✔
13% - 15%
0.23ms - 0.27ms
-
many_updates
  • Browser: chrome-headless 92.0.4515.131
  • Sample size: 50
  • Built by: Benchmarks #434
  • Commit: 5ace860

duration

VersionAvg timevs preact-mastervs preact-local
preact-master107.88ms - 111.89ms-faster ✔
62% - 65%
182.15ms - 206.56ms
preact-local292.19ms - 316.27msslower ❌
165% - 189%
182.15ms - 206.56ms
-

usedJSHeapSize

VersionAvg timevs preact-mastervs preact-local
preact-master5.37ms - 5.37ms-slower ❌
21% - 21%
0.93ms - 0.93ms
preact-local4.44ms - 4.45msfaster ✔
17% - 17%
0.93ms - 0.93ms
-
text_update
  • Browser: chrome-headless 92.0.4515.131
  • Sample size: 170
  • Built by: Benchmarks #434
  • Commit: 5ace860

duration

VersionAvg timevs preact-mastervs preact-local
preact-master74.93ms - 76.17ms-faster ✔
11% - 13%
9.34ms - 11.17ms
preact-local85.13ms - 86.47msslower ❌
12% - 15%
9.34ms - 11.17ms
-

usedJSHeapSize

VersionAvg timevs preact-mastervs preact-local
preact-master1.01ms - 1.04ms-slower ❌
4% - 7%
0.04ms - 0.06ms
preact-local0.97ms - 0.98msfaster ✔
4% - 6%
0.04ms - 0.06ms
-
todo
  • Browser: chrome-headless 92.0.4515.131
  • Sample size: 80
  • Built by: Benchmarks #434
  • Commit: 5ace860

duration

VersionAvg timevs preact-mastervs preact-local
preact-master62.70ms - 63.62ms-slower ❌
23% - 30%
11.69ms - 14.49ms
preact-local48.74ms - 51.39msfaster ✔
19% - 23%
11.69ms - 14.49ms
-

usedJSHeapSize

VersionAvg timevs preact-mastervs preact-local
preact-master1.02ms - 1.05ms-slower ❌
5% - 10%
0.05ms - 0.10ms
preact-local0.94ms - 0.97msfaster ✔
5% - 9%
0.05ms - 0.10ms
-

tachometer-reporter-action v2 for Benchmarks

github-actions[bot] avatar Aug 08 '21 22:08 github-actions[bot]

Size Change: +227 B (0%)

Total Size: 31.9 kB

Filename Size Change
compat/dist/compat.js 3.5 kB -1 B
compat/dist/compat.umd.js 3.57 kB -1 B
debug/dist/debug.js 3.21 kB +12 B (0%)
debug/dist/debug.umd.js 3.31 kB +11 B (0%)
dist/preact.js 4.51 kB +75 B (1%)
dist/preact.min.js 4.54 kB +69 B (1%)
dist/preact.umd.js 4.57 kB +50 B (1%)
hooks/dist/hooks.js 1.16 kB +9 B (0%)
hooks/dist/hooks.umd.js 1.24 kB +6 B (0%)
jsx-runtime/dist/jsxRuntime.js 340 B -2 B (0%)
jsx-runtime/dist/jsxRuntime.umd.js 424 B -1 B
ℹ️ View Unchanged
Filename Size Change
devtools/dist/devtools.js 232 B 0 B
devtools/dist/devtools.umd.js 316 B 0 B
test-utils/dist/testUtils.js 431 B 0 B
test-utils/dist/testUtils.umd.js 516 B 0 B

compressed-size-action

github-actions[bot] avatar Aug 08 '21 22:08 github-actions[bot]