TypeScript
TypeScript copied to clipboard
microsoft
[experiment] make tsc use the public API
Wacky test built on #55326 which makes tsc use the public API. Curious how bad the perf of this is.
The below represents effectively the smallest our package is going to get without splitting it into multiple packages.
Overall package size
| Before | After | Diff | Diff (percent) | |
|---|---|---|---|---|
| Packed | 3.78 MiB | 2.81 MiB | -990.82 KiB | -25.62% |
| Unpacked | 20.43 MiB | 14.85 MiB | -5.58 MiB | -27.31% |
Files
| Before | After | Diff | Diff (percent) | |
|---|---|---|---|---|
lib/tsc.js |
5.58 MiB | 2.31 KiB | -5.58 MiB | -99.96% |
Starting jobs; this comment will be updated as builds start and complete.
| Command | Status | Results |
|---|---|---|
perf test this faster |
✅ Started |
Starting jobs; this comment will be updated as builds start and complete.
| Command | Status | Results |
|---|---|---|
perf test this |
✅ Started | 👀 Results |
@jakebailey The results of the perf run you requested are in!
Here they are:
tsc
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Angular - node (v18.15.0, x64) | ||||||
| Memory used | 295,539k (± 0.00%) | 288,678k (± 0.02%) | -6,861k (- 2.32%) | 288,618k | 288,761k | p=0.005 n=6 |
| Parse Time | 2.66s (± 0.00%) | 2.71s (± 1.01%) | +0.05s (+ 2.01%) | 2.68s | 2.74s | p=0.003 n=6 |
| Bind Time | 0.83s (± 0.49%) | 0.84s (± 0.49%) | +0.01s (+ 1.21%) | 0.83s | 0.84s | p=0.008 n=6 |
| Check Time | 8.22s (± 0.31%) | 9.09s (± 0.33%) | 🔻+0.86s (+10.48%) | 9.05s | 9.12s | p=0.005 n=6 |
| Emit Time | 7.16s (± 0.41%) | 7.94s (± 0.35%) | 🔻+0.78s (+10.84%) | 7.89s | 7.97s | p=0.005 n=6 |
| Total Time | 18.88s (± 0.16%) | 20.57s (± 0.16%) | 🔻+1.70s (+ 9.00%) | 20.53s | 20.62s | p=0.005 n=6 |
| Compiler-Unions - node (v18.15.0, x64) | ||||||
| Memory used | 192,704k (± 0.94%) | 195,225k (± 0.93%) | ~ | 193,466k | 197,005k | p=0.066 n=6 |
| Parse Time | 1.35s (± 1.01%) | 1.39s (± 0.84%) | +0.04s (+ 2.83%) | 1.37s | 1.40s | p=0.006 n=6 |
| Bind Time | 0.72s (± 0.00%) | 0.74s (± 0.00%) | +0.02s (+ 2.78%) | 0.74s | 0.74s | p=0.001 n=6 |
| Check Time | 9.38s (± 0.48%) | 10.26s (± 0.39%) | 🔻+0.88s (+ 9.36%) | 10.20s | 10.31s | p=0.005 n=6 |
| Emit Time | 2.59s (± 0.20%) | 2.96s (± 0.51%) | 🔻+0.36s (+14.01%) | 2.93s | 2.97s | p=0.004 n=6 |
| Total Time | 14.05s (± 0.40%) | 15.35s (± 0.36%) | 🔻+1.30s (+ 9.28%) | 15.27s | 15.41s | p=0.005 n=6 |
| Monaco - node (v18.15.0, x64) | ||||||
| Memory used | 347,306k (± 0.00%) | 332,609k (± 0.01%) | 🟩-14,697k (- 4.23%) | 332,578k | 332,642k | p=0.005 n=6 |
| Parse Time | 2.48s (± 0.47%) | 2.38s (± 0.43%) | 🟩-0.10s (- 3.96%) | 2.37s | 2.40s | p=0.004 n=6 |
| Bind Time | 0.93s (± 0.44%) | 1.14s (± 1.43%) | 🔻+0.21s (+23.16%) | 1.12s | 1.17s | p=0.003 n=6 |
| Check Time | 6.97s (± 0.38%) | 7.77s (± 0.30%) | 🔻+0.80s (+11.53%) | 7.74s | 7.81s | p=0.005 n=6 |
| Emit Time | 4.06s (± 0.45%) | 4.55s (± 0.11%) | 🔻+0.49s (+12.11%) | 4.55s | 4.56s | p=0.004 n=6 |
| Total Time | 14.44s (± 0.29%) | 15.85s (± 0.16%) | 🔻+1.41s (+ 9.79%) | 15.82s | 15.88s | p=0.005 n=6 |
| TFS - node (v18.15.0, x64) | ||||||
| Memory used | 302,751k (± 0.01%) | 295,160k (± 0.12%) | -7,591k (- 2.51%) | 294,702k | 295,476k | p=0.005 n=6 |
| Parse Time | 2.02s (± 1.03%) | 2.01s (± 0.60%) | ~ | 1.99s | 2.02s | p=0.667 n=6 |
| Bind Time | 1.00s (± 1.22%) | 1.06s (± 1.10%) | 🔻+0.06s (+ 5.64%) | 1.04s | 1.07s | p=0.004 n=6 |
| Check Time | 6.36s (± 0.22%) | 7.15s (± 0.67%) | 🔻+0.79s (+12.48%) | 7.09s | 7.20s | p=0.005 n=6 |
| Emit Time | 3.61s (± 0.44%) | 4.10s (± 0.22%) | 🔻+0.49s (+13.52%) | 4.09s | 4.11s | p=0.005 n=6 |
| Total Time | 12.99s (± 0.20%) | 14.32s (± 0.45%) | 🔻+1.33s (+10.26%) | 14.24s | 14.39s | p=0.005 n=6 |
| material-ui - node (v18.15.0, x64) | ||||||
| Memory used | 511,226k (± 0.00%) | 489,715k (± 0.02%) | 🟩-21,512k (- 4.21%) | 489,675k | 489,876k | p=0.005 n=6 |
| Parse Time | 2.64s (± 0.66%) | 2.68s (± 1.32%) | +0.04s (+ 1.45%) | 2.65s | 2.75s | p=0.029 n=6 |
| Bind Time | 0.99s (± 0.83%) | 1.08s (± 0.00%) | 🔻+0.09s (+ 9.46%) | 1.08s | 1.08s | p=0.003 n=6 |
| Check Time | 17.24s (± 0.35%) | 18.55s (± 0.29%) | 🔻+1.31s (+ 7.61%) | 18.49s | 18.62s | p=0.005 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 20.87s (± 0.27%) | 22.31s (± 0.26%) | 🔻+1.44s (+ 6.91%) | 22.22s | 22.37s | p=0.005 n=6 |
| mui-docs - node (v18.15.0, x64) | ||||||
| Memory used | 1,789,578k (± 0.00%) | 1,696,348k (± 0.00%) | 🟩-93,230k (- 5.21%) | 1,696,297k | 1,696,419k | p=0.005 n=6 |
| Parse Time | 6.64s (± 0.38%) | 6.68s (± 0.58%) | ~ | 6.62s | 6.73s | p=0.091 n=6 |
| Bind Time | 2.39s (± 0.74%) | 2.02s (± 0.60%) | 🟩-0.37s (-15.44%) | 2.00s | 2.03s | p=0.004 n=6 |
| Check Time | 59.01s (± 0.50%) | 65.26s (± 0.31%) | 🔻+6.24s (+10.58%) | 64.89s | 65.43s | p=0.005 n=6 |
| Emit Time | 0.16s (± 3.16%) | 0.17s (± 3.32%) | ~ | 0.16s | 0.17s | p=0.640 n=6 |
| Total Time | 68.19s (± 0.41%) | 74.12s (± 0.32%) | 🔻+5.92s (+ 8.69%) | 73.68s | 74.28s | p=0.005 n=6 |
| self-build-src - node (v18.15.0, x64) | ||||||
| Memory used | 2,394,316k (± 0.03%) | 2,359,404k (± 0.03%) | -34,912k (- 1.46%) | 2,358,598k | 2,360,433k | p=0.005 n=6 |
| Parse Time | 5.06s (± 0.53%) | 5.22s (± 1.59%) | +0.17s (+ 3.33%) | 5.08s | 5.32s | p=0.008 n=6 |
| Bind Time | 1.90s (± 0.72%) | 1.79s (± 1.06%) | 🟩-0.11s (- 5.62%) | 1.77s | 1.82s | p=0.005 n=6 |
| Check Time | 33.75s (± 0.20%) | 36.58s (± 0.76%) | 🔻+2.83s (+ 8.38%) | 36.17s | 36.94s | p=0.005 n=6 |
| Emit Time | 2.65s (± 2.01%) | 2.81s (± 2.75%) | 🔻+0.16s (+ 5.97%) | 2.69s | 2.92s | p=0.012 n=6 |
| Total Time | 43.36s (± 0.22%) | 46.42s (± 0.58%) | 🔻+3.06s (+ 7.05%) | 46.02s | 46.79s | p=0.005 n=6 |
| self-compiler - node (v18.15.0, x64) | ||||||
| Memory used | 414,484k (± 0.01%) | 405,142k (± 0.01%) | -9,342k (- 2.25%) | 405,098k | 405,172k | p=0.005 n=6 |
| Parse Time | 2.81s (± 0.95%) | 2.72s (± 0.73%) | 🟩-0.10s (- 3.55%) | 2.69s | 2.75s | p=0.005 n=6 |
| Bind Time | 1.06s (± 0.77%) | 1.29s (± 0.63%) | 🔻+0.23s (+21.63%) | 1.28s | 1.30s | p=0.004 n=6 |
| Check Time | 15.15s (± 0.34%) | 16.39s (± 0.41%) | 🔻+1.24s (+ 8.20%) | 16.30s | 16.47s | p=0.005 n=6 |
| Emit Time | 1.09s (± 1.26%) | 1.13s (± 1.80%) | +0.04s (+ 3.35%) | 1.11s | 1.17s | p=0.006 n=6 |
| Total Time | 20.13s (± 0.35%) | 21.53s (± 0.32%) | 🔻+1.41s (+ 6.98%) | 21.43s | 21.60s | p=0.005 n=6 |
| vscode - node (v18.15.0, x64) | ||||||
| Memory used | 2,865,824k (± 0.00%) | 2,726,798k (± 0.00%) | 🟩-139,026k (- 4.85%) | 2,726,680k | 2,726,919k | p=0.005 n=6 |
| Parse Time | 10.75s (± 0.33%) | 10.90s (± 0.45%) | +0.15s (+ 1.41%) | 10.81s | 10.95s | p=0.005 n=6 |
| Bind Time | 3.45s (± 0.35%) | 3.58s (± 0.27%) | +0.13s (+ 3.72%) | 3.57s | 3.59s | p=0.005 n=6 |
| Check Time | 61.20s (± 0.26%) | 67.31s (± 0.68%) | 🔻+6.11s (+ 9.98%) | 66.79s | 68.06s | p=0.005 n=6 |
| Emit Time | 16.23s (± 0.86%) | 17.99s (± 0.53%) | 🔻+1.77s (+10.89%) | 17.91s | 18.16s | p=0.005 n=6 |
| Total Time | 91.63s (± 0.30%) | 99.79s (± 0.37%) | 🔻+8.15s (+ 8.90%) | 99.41s | 100.39s | p=0.005 n=6 |
| webpack - node (v18.15.0, x64) | ||||||
| Memory used | 397,064k (± 0.03%) | 385,978k (± 0.03%) | -11,086k (- 2.79%) | 385,841k | 386,115k | p=0.005 n=6 |
| Parse Time | 3.13s (± 0.66%) | 3.09s (± 0.99%) | ~ | 3.06s | 3.14s | p=0.086 n=6 |
| Bind Time | 1.39s (± 0.88%) | 1.48s (± 1.16%) | 🔻+0.10s (+ 6.98%) | 1.46s | 1.51s | p=0.005 n=6 |
| Check Time | 13.96s (± 0.53%) | 14.88s (± 0.33%) | 🔻+0.92s (+ 6.61%) | 14.83s | 14.97s | p=0.005 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 18.47s (± 0.35%) | 19.46s (± 0.28%) | 🔻+0.99s (+ 5.33%) | 19.38s | 19.52s | p=0.005 n=6 |
| xstate - node (v18.15.0, x64) | ||||||
| Memory used | 513,146k (± 0.01%) | 506,008k (± 3.61%) | ~ | 494,121k | 529,599k | p=0.378 n=6 |
| Parse Time | 3.27s (± 0.27%) | 3.31s (± 0.41%) | +0.04s (+ 1.12%) | 3.29s | 3.32s | p=0.005 n=6 |
| Bind Time | 1.54s (± 0.41%) | 1.49s (± 0.37%) | 🟩-0.05s (- 3.57%) | 1.48s | 1.49s | p=0.004 n=6 |
| Check Time | 2.86s (± 0.61%) | 3.12s (± 0.48%) | 🔻+0.27s (+ 9.33%) | 3.11s | 3.15s | p=0.005 n=6 |
| Emit Time | 0.08s (± 4.99%) | 0.11s (± 3.76%) | 🔻+0.03s (+32.65%) | 0.10s | 0.11s | p=0.003 n=6 |
| Total Time | 7.75s (± 0.21%) | 8.03s (± 0.17%) | +0.28s (+ 3.63%) | 8.01s | 8.05s | p=0.005 n=6 |
System info unknown
Hosts
- node (v18.15.0, x64)
Scenarios
- Angular - node (v18.15.0, x64)
- Compiler-Unions - node (v18.15.0, x64)
- Monaco - node (v18.15.0, x64)
- TFS - node (v18.15.0, x64)
- material-ui - node (v18.15.0, x64)
- mui-docs - node (v18.15.0, x64)
- self-build-src - node (v18.15.0, x64)
- self-compiler - node (v18.15.0, x64)
- vscode - node (v18.15.0, x64)
- webpack - node (v18.15.0, x64)
- xstate - node (v18.15.0, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
tsserver
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Compiler-UnionsTSServer - node (v18.15.0, x64) | ||||||
| Req 1 - updateOpen | 2,359ms (± 0.84%) | 2,345ms (± 0.67%) | ~ | 2,324ms | 2,361ms | p=0.378 n=6 |
| Req 2 - geterr | 5,574ms (± 1.63%) | 5,654ms (± 0.25%) | ~ | 5,641ms | 5,673ms | p=0.230 n=6 |
| Req 3 - references | 328ms (± 1.22%) | 324ms (± 1.09%) | ~ | 322ms | 331ms | p=0.098 n=6 |
| Req 4 - navto | 274ms (± 0.90%) | 271ms (± 0.19%) | -3ms (- 1.03%) | 271ms | 272ms | p=0.036 n=6 |
| Req 5 - completionInfo count | 1,357 (± 0.00%) | 1,357 (± 0.00%) | ~ | 1,357 | 1,357 | p=1.000 n=6 |
| Req 5 - completionInfo | 85ms (± 8.46%) | 93ms (± 0.55%) | ~ | 93ms | 94ms | p=0.077 n=6 |
| CompilerTSServer - node (v18.15.0, x64) | ||||||
| Req 1 - updateOpen | 2,498ms (± 0.87%) | 2,507ms (± 0.61%) | ~ | 2,484ms | 2,522ms | p=0.471 n=6 |
| Req 2 - geterr | 4,185ms (± 1.55%) | 4,276ms (± 0.27%) | +91ms (+ 2.17%) | 4,262ms | 4,294ms | p=0.031 n=6 |
| Req 3 - references | 337ms (± 1.54%) | 336ms (± 1.26%) | ~ | 331ms | 340ms | p=0.331 n=6 |
| Req 4 - navto | 285ms (± 0.56%) | 284ms (± 0.14%) | ~ | 283ms | 284ms | p=0.121 n=6 |
| Req 5 - completionInfo count | 1,519 (± 0.00%) | 1,519 (± 0.00%) | ~ | 1,519 | 1,519 | p=1.000 n=6 |
| Req 5 - completionInfo | 85ms (± 7.83%) | 83ms (± 6.92%) | ~ | 76ms | 88ms | p=0.368 n=6 |
| xstateTSServer - node (v18.15.0, x64) | ||||||
| Req 1 - updateOpen | 2,600ms (± 0.45%) | 2,617ms (± 0.32%) | +17ms (+ 0.67%) | 2,606ms | 2,626ms | p=0.037 n=6 |
| Req 2 - geterr | 1,732ms (± 2.65%) | 1,706ms (± 2.38%) | ~ | 1,674ms | 1,783ms | p=0.575 n=6 |
| Req 3 - references | 117ms (± 8.72%) | 116ms (± 8.96%) | ~ | 106ms | 126ms | p=0.681 n=6 |
| Req 4 - navto | 371ms (± 0.22%) | 371ms (± 0.72%) | ~ | 369ms | 376ms | p=0.230 n=6 |
| Req 5 - completionInfo count | 2,079 (± 0.00%) | 2,079 (± 0.00%) | ~ | 2,079 | 2,079 | p=1.000 n=6 |
| Req 5 - completionInfo | 309ms (± 1.13%) | 305ms (± 1.11%) | -5ms (- 1.51%) | 301ms | 311ms | p=0.029 n=6 |
System info unknown
Hosts
- node (v18.15.0, x64)
Scenarios
- CompilerTSServer - node (v18.15.0, x64)
- Compiler-UnionsTSServer - node (v18.15.0, x64)
- xstateTSServer - node (v18.15.0, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
startup
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| tsc-startup - node (v18.15.0, x64) | ||||||
| Execution time | 152.95ms (± 0.18%) | 227.82ms (± 0.19%) | 🔻+74.87ms (+48.95%) | 226.46ms | 235.61ms | p=0.000 n=600 |
| tsserver-startup - node (v18.15.0, x64) | ||||||
| Execution time | 229.09ms (± 0.14%) | 228.61ms (± 0.22%) | -0.48ms (- 0.21%) | 226.94ms | 245.55ms | p=0.000 n=600 |
| tsserverlibrary-startup - node (v18.15.0, x64) | ||||||
| Execution time | 221.77ms (± 0.15%) | 222.60ms (± 0.16%) | +0.83ms (+ 0.37%) | 220.99ms | 229.38ms | p=0.000 n=600 |
| typescript-startup - node (v18.15.0, x64) | ||||||
| Execution time | 221.74ms (± 0.17%) | 222.49ms (± 0.19%) | +0.74ms (+ 0.34%) | 221.01ms | 234.82ms | p=0.000 n=600 |
System info unknown
Hosts
- node (v18.15.0, x64)
Scenarios
- tsc-startup - node (v18.15.0, x64)
- tsserver-startup - node (v18.15.0, x64)
- tsserverlibrary-startup - node (v18.15.0, x64)
- typescript-startup - node (v18.15.0, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Developer Information:
:eyes:
As someone who tried very hard to replicate tsc behavior using the compiler API, I don’t envy anyone else who has to do it. readDirectory was particularly fun to try to get right.
Are you talking about not having the executeCommandLine function, or that you wanted tsc's perf characteristics?
In my case I didn’t care about perf - just that the same tsconfig produces exactly the same behavior and compiled output as the same tsconfig provided to tsc. For any arbitrary config. I feel like I got close, but I’m sure there are a lot of edge cases I missed.
Rebased this PR now that #55326 is in; to test out the services perf, this PR can be cherry-picked in elsewhere to run perf tests.
#58045 is in, so retesting to gauge how much is left:
@typescript-bot perf test this faster
Starting jobs; this comment will be updated as builds start and complete.
| Command | Status | Results |
|---|---|---|
perf test this faster |
✅ Started | 👀 Results |
@jakebailey The results of the perf run you requested are in!
Here they are:
tsc
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Angular - node (v18.15.0, x64) | ||||||
| Memory used | 295,774k (± 0.01%) | 301,973k (± 0.01%) | +6,200k (+ 2.10%) | 301,910k | 302,028k | p=0.005 n=6 |
| Parse Time | 2.65s (± 0.82%) | 2.72s (± 0.89%) | +0.07s (+ 2.58%) | 2.67s | 2.74s | p=0.006 n=6 |
| Bind Time | 0.82s (± 1.26%) | 0.82s (± 0.92%) | ~ | 0.81s | 0.83s | p=0.664 n=6 |
| Check Time | 8.19s (± 0.30%) | 8.29s (± 0.28%) | +0.10s (+ 1.24%) | 8.25s | 8.31s | p=0.004 n=6 |
| Emit Time | 7.04s (± 0.29%) | 7.08s (± 0.42%) | ~ | 7.03s | 7.11s | p=0.076 n=6 |
| Total Time | 18.70s (± 0.24%) | 18.90s (± 0.34%) | +0.21s (+ 1.11%) | 18.82s | 18.98s | p=0.005 n=6 |
| Compiler-Unions - node (v18.15.0, x64) | ||||||
| Memory used | 192,839k (± 0.95%) | 198,438k (± 0.81%) | +5,600k (+ 2.90%) | 196,881k | 201,601k | p=0.005 n=6 |
| Parse Time | 2.03s (± 0.92%) | 2.07s (± 1.57%) | ~ | 2.03s | 2.11s | p=0.061 n=6 |
| Bind Time | 1.07s (± 0.97%) | 1.07s (± 0.70%) | ~ | 1.06s | 1.08s | p=0.437 n=6 |
| Check Time | 13.82s (± 0.28%) | 13.87s (± 0.82%) | ~ | 13.68s | 13.99s | p=0.297 n=6 |
| Emit Time | 3.85s (± 0.62%) | 3.81s (± 3.39%) | ~ | 3.73s | 4.07s | p=0.064 n=6 |
| Total Time | 20.76s (± 0.24%) | 20.81s (± 0.45%) | ~ | 20.65s | 20.92s | p=0.227 n=6 |
| Monaco - node (v18.15.0, x64) | ||||||
| Memory used | 347,719k (± 0.01%) | 353,644k (± 0.00%) | +5,925k (+ 1.70%) | 353,626k | 353,663k | p=0.005 n=6 |
| Parse Time | 3.68s (± 1.10%) | 3.56s (± 0.84%) | 🟩-0.12s (- 3.17%) | 3.52s | 3.60s | p=0.005 n=6 |
| Bind Time | 1.32s (± 1.50%) | 1.53s (± 0.58%) | 🔻+0.21s (+16.35%) | 1.52s | 1.54s | p=0.005 n=6 |
| Check Time | 10.09s (± 0.47%) | 10.10s (± 0.34%) | ~ | 10.05s | 10.15s | p=0.687 n=6 |
| Emit Time | 6.01s (± 0.33%) | 6.05s (± 0.21%) | +0.04s (+ 0.61%) | 6.04s | 6.07s | p=0.021 n=6 |
| Total Time | 21.10s (± 0.32%) | 21.25s (± 0.08%) | +0.15s (+ 0.72%) | 21.23s | 21.28s | p=0.005 n=6 |
| TFS - node (v18.15.0, x64) | ||||||
| Memory used | 302,551k (± 0.00%) | 308,234k (± 0.00%) | +5,683k (+ 1.88%) | 308,217k | 308,244k | p=0.005 n=6 |
| Parse Time | 2.96s (± 0.93%) | 3.00s (± 0.71%) | +0.05s (+ 1.58%) | 2.96s | 3.02s | p=0.019 n=6 |
| Bind Time | 1.43s (± 0.53%) | 1.46s (± 0.37%) | +0.03s (+ 2.33%) | 1.46s | 1.47s | p=0.004 n=6 |
| Check Time | 9.17s (± 0.36%) | 9.18s (± 0.26%) | ~ | 9.15s | 9.21s | p=0.747 n=6 |
| Emit Time | 5.30s (± 0.56%) | 5.34s (± 0.40%) | +0.04s (+ 0.75%) | 5.30s | 5.36s | p=0.036 n=6 |
| Total Time | 18.86s (± 0.31%) | 18.99s (± 0.11%) | +0.13s (+ 0.69%) | 18.97s | 19.02s | p=0.005 n=6 |
| material-ui - node (v18.15.0, x64) | ||||||
| Memory used | 510,560k (± 0.00%) | 517,595k (± 0.00%) | +7,035k (+ 1.38%) | 517,562k | 517,622k | p=0.005 n=6 |
| Parse Time | 3.95s (± 0.47%) | 3.99s (± 0.43%) | +0.05s (+ 1.18%) | 3.97s | 4.02s | p=0.005 n=6 |
| Bind Time | 1.46s (± 0.94%) | 1.50s (± 1.19%) | +0.04s (+ 2.97%) | 1.48s | 1.53s | p=0.006 n=6 |
| Check Time | 25.27s (± 0.59%) | 25.31s (± 0.37%) | ~ | 25.21s | 25.48s | p=0.575 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 30.68s (± 0.51%) | 30.80s (± 0.30%) | ~ | 30.68s | 30.96s | p=0.261 n=6 |
| mui-docs - node (v18.15.0, x64) | ||||||
| Memory used | 1,743,936k (± 0.00%) | 1,749,619k (± 0.00%) | +5,683k (+ 0.33%) | 1,749,568k | 1,749,684k | p=0.005 n=6 |
| Parse Time | 7.78s (± 0.48%) | 7.96s (± 0.29%) | +0.18s (+ 2.31%) | 7.93s | 8.00s | p=0.005 n=6 |
| Bind Time | 2.75s (± 0.58%) | 2.21s (± 0.88%) | 🟩-0.54s (-19.53%) | 2.20s | 2.25s | p=0.005 n=6 |
| Check Time | 66.51s (± 0.29%) | 68.74s (± 1.51%) | +2.23s (+ 3.35%) | 67.32s | 70.48s | p=0.005 n=6 |
| Emit Time | 0.15s (± 3.36%) | 0.16s (± 2.58%) | ~ | 0.15s | 0.16s | p=0.112 n=6 |
| Total Time | 77.20s (± 0.27%) | 79.07s (± 1.31%) | +1.88s (+ 2.43%) | 77.65s | 80.80s | p=0.005 n=6 |
| self-build-src - node (v18.15.0, x64) | ||||||
| Memory used | 2,299,624k (± 0.02%) | 2,383,798k (± 0.05%) | +84,174k (+ 3.66%) | 2,382,033k | 2,384,813k | p=0.005 n=6 |
| Parse Time | 7.45s (± 0.81%) | 7.74s (± 1.49%) | +0.29s (+ 3.85%) | 7.58s | 7.90s | p=0.005 n=6 |
| Bind Time | 2.71s (± 0.59%) | 2.49s (± 1.09%) | 🟩-0.22s (- 8.12%) | 2.46s | 2.53s | p=0.005 n=6 |
| Check Time | 48.73s (± 0.52%) | 49.32s (± 0.41%) | +0.59s (+ 1.21%) | 49.10s | 49.70s | p=0.008 n=6 |
| Emit Time | 3.81s (± 2.41%) | 3.84s (± 1.99%) | ~ | 3.74s | 3.93s | p=0.575 n=6 |
| Total Time | 62.71s (± 0.35%) | 63.39s (± 0.34%) | +0.68s (+ 1.08%) | 63.14s | 63.72s | p=0.005 n=6 |
| self-build-src-public-api - node (v18.15.0, x64) | ||||||
| Memory used | 2,374,309k (± 0.04%) | 2,374,207k (± 0.04%) | ~ | 2,373,022k | 2,375,170k | p=0.936 n=6 |
| Parse Time | 7.74s (± 1.32%) | 7.74s (± 1.22%) | ~ | 7.61s | 7.86s | p=1.000 n=6 |
| Bind Time | 2.46s (± 0.72%) | 2.45s (± 0.65%) | ~ | 2.43s | 2.47s | p=0.686 n=6 |
| Check Time | 49.11s (± 0.25%) | 49.25s (± 0.28%) | ~ | 49.03s | 49.45s | p=0.093 n=6 |
| Emit Time | 3.89s (± 1.63%) | 3.92s (± 3.53%) | ~ | 3.74s | 4.09s | p=0.575 n=6 |
| Total Time | 63.22s (± 0.27%) | 63.38s (± 0.49%) | ~ | 62.85s | 63.74s | p=0.298 n=6 |
| self-compiler - node (v18.15.0, x64) | ||||||
| Memory used | 418,048k (± 0.01%) | 423,703k (± 0.01%) | +5,655k (+ 1.35%) | 423,605k | 423,783k | p=0.005 n=6 |
| Parse Time | 4.16s (± 0.48%) | 4.14s (± 1.76%) | ~ | 4.02s | 4.25s | p=0.285 n=6 |
| Bind Time | 1.62s (± 0.61%) | 1.63s (± 1.91%) | ~ | 1.60s | 1.68s | p=0.864 n=6 |
| Check Time | 21.98s (± 0.49%) | 22.05s (± 0.12%) | ~ | 22.00s | 22.07s | p=0.378 n=6 |
| Emit Time | 1.71s (± 1.47%) | 1.71s (± 1.68%) | ~ | 1.69s | 1.77s | p=0.567 n=6 |
| Total Time | 29.46s (± 0.38%) | 29.53s (± 0.29%) | ~ | 29.38s | 29.63s | p=0.376 n=6 |
| vscode - node (v18.15.0, x64) | ||||||
| Memory used | 2,904,155k (± 0.00%) | 2,906,129k (± 0.00%) | +1,974k (+ 0.07%) | 2,906,088k | 2,906,168k | p=0.005 n=6 |
| Parse Time | 15.97s (± 0.55%) | 16.45s (± 0.54%) | +0.48s (+ 3.03%) | 16.35s | 16.57s | p=0.005 n=6 |
| Bind Time | 4.94s (± 0.64%) | 5.07s (± 2.62%) | ~ | 4.88s | 5.18s | p=0.226 n=6 |
| Check Time | 86.77s (± 0.53%) | 86.83s (± 0.51%) | ~ | 86.20s | 87.41s | p=1.000 n=6 |
| Emit Time | 23.82s (± 0.32%) | 24.66s (± 7.97%) | ~ | 23.76s | 28.67s | p=0.575 n=6 |
| Total Time | 131.51s (± 0.32%) | 133.02s (± 1.54%) | +1.51s (+ 1.15%) | 131.77s | 137.15s | p=0.031 n=6 |
| webpack - node (v18.15.0, x64) | ||||||
| Memory used | 408,616k (± 0.01%) | 415,309k (± 0.01%) | +6,693k (+ 1.64%) | 415,250k | 415,340k | p=0.005 n=6 |
| Parse Time | 3.24s (± 0.49%) | 3.33s (± 1.16%) | +0.09s (+ 2.83%) | 3.29s | 3.39s | p=0.005 n=6 |
| Bind Time | 1.38s (± 0.87%) | 1.38s (± 0.96%) | ~ | 1.36s | 1.39s | p=0.591 n=6 |
| Check Time | 14.16s (± 0.21%) | 14.31s (± 0.22%) | +0.15s (+ 1.06%) | 14.28s | 14.37s | p=0.005 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 18.79s (± 0.17%) | 19.02s (± 0.27%) | +0.24s (+ 1.25%) | 18.96s | 19.09s | p=0.005 n=6 |
| xstate - node (v18.15.0, x64) | ||||||
| Memory used | 514,380k (± 0.02%) | 532,654k (± 0.03%) | +18,274k (+ 3.55%) | 532,437k | 532,770k | p=0.005 n=6 |
| Parse Time | 4.87s (± 0.44%) | 4.96s (± 0.48%) | +0.09s (+ 1.81%) | 4.94s | 5.00s | p=0.005 n=6 |
| Bind Time | 2.31s (± 1.33%) | 2.05s (± 1.14%) | 🟩-0.25s (-10.91%) | 2.02s | 2.08s | p=0.005 n=6 |
| Check Time | 4.24s (± 0.66%) | 4.41s (± 1.12%) | 🔻+0.17s (+ 4.13%) | 4.35s | 4.50s | p=0.005 n=6 |
| Emit Time | 0.11s (± 7.27%) | 0.11s (± 7.27%) | ~ | 0.10s | 0.12s | p=0.796 n=6 |
| Total Time | 11.54s (± 0.34%) | 11.54s (± 0.73%) | ~ | 11.44s | 11.67s | p=0.873 n=6 |
System info unknown
Hosts
- node (v18.15.0, x64)
Scenarios
- Angular - node (v18.15.0, x64)
- Compiler-Unions - node (v18.15.0, x64)
- Monaco - node (v18.15.0, x64)
- TFS - node (v18.15.0, x64)
- material-ui - node (v18.15.0, x64)
- mui-docs - node (v18.15.0, x64)
- self-build-src - node (v18.15.0, x64)
- self-build-src-public-api - node (v18.15.0, x64)
- self-compiler - node (v18.15.0, x64)
- vscode - node (v18.15.0, x64)
- webpack - node (v18.15.0, x64)
- xstate - node (v18.15.0, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Developer Information:
Starting jobs; this comment will be updated as builds start and complete.
| Command | Status | Results |
|---|---|---|
perf test this faster |
✅ Started | 👀 Results |
perf test this faster [email protected] |
✅ Started | 👀 Results |
@jakebailey The results of the perf run you requested are in!
Here they are:
tsc
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Compiler-Unions - node (v18.15.0, x64) | ||||||
| Errors | 30 | 30 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 62,153 | 62,153 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 50,242 | 50,242 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 194,633k (± 0.94%) | 198,240k (± 0.73%) | +3,607k (+ 1.85%) | 197,614k | 201,198k | p=0.005 n=6 |
| Parse Time | 1.95s (± 1.27%) | 2.01s (± 1.50%) | +0.06s (+ 2.99%) | 1.95s | 2.03s | p=0.016 n=6 |
| Bind Time | 1.06s (± 1.19%) | 1.07s (± 1.28%) | ~ | 1.05s | 1.09s | p=0.615 n=6 |
| Check Time | 14.01s (± 0.40%) | 13.98s (± 0.60%) | ~ | 13.88s | 14.07s | p=0.872 n=6 |
| Emit Time | 4.00s (± 0.73%) | 4.31s (± 0.52%) | 🔻+0.31s (+ 7.84%) | 4.27s | 4.33s | p=0.005 n=6 |
| Total Time | 21.02s (± 0.14%) | 21.36s (± 0.57%) | +0.35s (+ 1.66%) | 21.21s | 21.49s | p=0.005 n=6 |
| angular-1 - node (v18.15.0, x64) | ||||||
| Errors | 7 | 7 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 945,757 | 945,757 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 410,067 | 410,067 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 1,222,591k (± 0.00%) | 1,227,303k (± 0.00%) | +4,712k (+ 0.39%) | 1,227,242k | 1,227,373k | p=0.005 n=6 |
| Parse Time | 7.95s (± 0.52%) | 7.51s (± 0.29%) | 🟩-0.44s (- 5.56%) | 7.47s | 7.53s | p=0.005 n=6 |
| Bind Time | 2.23s (± 0.34%) | 2.87s (± 0.18%) | 🔻+0.64s (+28.65%) | 2.86s | 2.87s | p=0.004 n=6 |
| Check Time | 36.21s (± 0.38%) | 36.44s (± 0.15%) | +0.23s (+ 0.65%) | 36.37s | 36.51s | p=0.010 n=6 |
| Emit Time | 17.80s (± 0.34%) | 17.96s (± 0.57%) | +0.16s (+ 0.91%) | 17.85s | 18.13s | p=0.013 n=6 |
| Total Time | 64.19s (± 0.17%) | 64.78s (± 0.15%) | +0.59s (+ 0.92%) | 64.70s | 64.95s | p=0.005 n=6 |
| mui-docs - node (v18.15.0, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 2,505,734 | 2,505,734 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 993,039 | 993,039 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 2,376,611k (± 0.00%) | 2,383,257k (± 0.00%) | +6,646k (+ 0.28%) | 2,383,204k | 2,383,300k | p=0.005 n=6 |
| Parse Time | 10.96s (± 0.33%) | 11.10s (± 0.16%) | +0.14s (+ 1.31%) | 11.08s | 11.13s | p=0.005 n=6 |
| Bind Time | 2.60s (± 0.60%) | 2.61s (± 0.48%) | ~ | 2.60s | 2.63s | p=0.328 n=6 |
| Check Time | 86.78s (± 0.43%) | 87.59s (± 0.78%) | +0.81s (+ 0.94%) | 86.49s | 88.50s | p=0.045 n=6 |
| Emit Time | 0.32s (± 3.42%) | 0.34s (± 2.49%) | 🔻+0.02s (+ 4.69%) | 0.32s | 0.34s | p=0.030 n=6 |
| Total Time | 100.66s (± 0.41%) | 101.64s (± 0.66%) | +0.98s (+ 0.97%) | 100.53s | 102.51s | p=0.031 n=6 |
| self-build-src - node (v18.15.0, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 1,231,417 | 1,241,520 | +10,103 (+ 0.82%) | ~ | ~ | p=0.001 n=6 |
| Types | 264,363 | 264,401 | +38 (+ 0.01%) | ~ | ~ | p=0.001 n=6 |
| Memory used | 2,530,359k (± 7.68%) | 2,487,972k (± 3.26%) | ~ | 2,435,025k | 2,593,163k | p=1.000 n=6 |
| Parse Time | 6.05s (± 1.53%) | 6.30s (± 0.82%) | 🔻+0.25s (+ 4.13%) | 6.25s | 6.40s | p=0.005 n=6 |
| Bind Time | 2.25s (± 1.60%) | 2.03s (± 0.57%) | 🟩-0.22s (- 9.77%) | 2.01s | 2.04s | p=0.005 n=6 |
| Check Time | 40.71s (± 0.99%) | 41.67s (± 0.61%) | +0.95s (+ 2.34%) | 41.33s | 41.99s | p=0.005 n=6 |
| Emit Time | 4.03s (± 1.18%) | 4.08s (± 3.48%) | ~ | 3.99s | 4.37s | p=0.748 n=6 |
| Total Time | 53.07s (± 0.79%) | 54.10s (± 0.50%) | +1.03s (+ 1.95%) | 53.71s | 54.38s | p=0.005 n=6 |
| self-build-src-public-api - node (v18.15.0, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 1,231,417 | 1,241,520 | +10,103 (+ 0.82%) | ~ | ~ | p=0.001 n=6 |
| Types | 264,363 | 264,401 | +38 (+ 0.01%) | ~ | ~ | p=0.001 n=6 |
| Memory used | 2,426,186k (± 0.03%) | 2,505,253k (± 3.42%) | +79,067k (+ 3.26%) | 2,426,738k | 2,583,888k | p=0.020 n=6 |
| Parse Time | 6.24s (± 0.61%) | 6.30s (± 0.79%) | ~ | 6.24s | 6.36s | p=0.078 n=6 |
| Bind Time | 2.04s (± 1.57%) | 2.00s (± 1.03%) | ~ | 1.98s | 2.03s | p=0.090 n=6 |
| Check Time | 41.62s (± 0.56%) | 41.71s (± 0.63%) | ~ | 41.34s | 41.95s | p=0.471 n=6 |
| Emit Time | 4.07s (± 0.55%) | 4.13s (± 2.98%) | ~ | 4.02s | 4.36s | p=0.520 n=6 |
| Total Time | 53.98s (± 0.39%) | 54.13s (± 0.49%) | ~ | 53.67s | 54.34s | p=0.173 n=6 |
| self-compiler - node (v18.15.0, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 256,907 | 256,907 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 105,594 | 105,594 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 429,306k (± 0.02%) | 434,878k (± 0.02%) | +5,573k (+ 1.30%) | 434,689k | 434,959k | p=0.005 n=6 |
| Parse Time | 3.35s (± 0.41%) | 3.41s (± 0.44%) | +0.05s (+ 1.59%) | 3.38s | 3.42s | p=0.005 n=6 |
| Bind Time | 1.29s (± 1.36%) | 1.28s (± 0.94%) | ~ | 1.27s | 1.30s | p=1.000 n=6 |
| Check Time | 18.07s (± 0.44%) | 18.05s (± 0.37%) | ~ | 17.95s | 18.12s | p=1.000 n=6 |
| Emit Time | 1.64s (± 1.14%) | 1.67s (± 0.99%) | ~ | 1.64s | 1.68s | p=0.089 n=6 |
| Total Time | 24.36s (± 0.29%) | 24.40s (± 0.25%) | ~ | 24.31s | 24.47s | p=0.261 n=6 |
| ts-pre-modules - node (v18.15.0, x64) | ||||||
| Errors | 35 | 35 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 225,018 | 225,018 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 94,245 | 94,245 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 370,112k (± 0.02%) | 375,975k (± 0.02%) | +5,863k (+ 1.58%) | 375,889k | 376,060k | p=0.005 n=6 |
| Parse Time | 2.28s (± 0.58%) | 2.37s (± 0.82%) | +0.09s (+ 3.80%) | 2.35s | 2.40s | p=0.005 n=6 |
| Bind Time | 1.32s (± 1.71%) | 1.37s (± 1.81%) | +0.05s (+ 3.92%) | 1.32s | 1.39s | p=0.010 n=6 |
| Check Time | 13.34s (± 0.35%) | 13.39s (± 0.24%) | ~ | 13.36s | 13.44s | p=0.108 n=6 |
| Emit Time | 0.00s | 0.00s | ~ | ~ | ~ | p=1.000 n=6 |
| Total Time | 16.94s (± 0.28%) | 17.13s (± 0.28%) | +0.19s (+ 1.10%) | 17.06s | 17.19s | p=0.005 n=6 |
| vscode - node (v18.15.0, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 3,006,618 | 3,006,618 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 1,035,512 | 1,035,512 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 3,130,125k (± 0.00%) | 3,131,892k (± 0.00%) | +1,767k (+ 0.06%) | 3,131,858k | 3,131,920k | p=0.005 n=6 |
| Parse Time | 17.30s (± 0.38%) | 17.40s (± 0.12%) | +0.10s (+ 0.57%) | 17.37s | 17.43s | p=0.010 n=6 |
| Bind Time | 5.23s (± 0.35%) | 5.24s (± 0.41%) | ~ | 5.21s | 5.27s | p=0.745 n=6 |
| Check Time | 96.79s (± 0.31%) | 97.22s (± 0.19%) | +0.43s (+ 0.45%) | 97.02s | 97.45s | p=0.010 n=6 |
| Emit Time | 24.96s (± 0.76%) | 25.05s (± 0.36%) | ~ | 24.94s | 25.20s | p=0.297 n=6 |
| Total Time | 144.27s (± 0.25%) | 144.91s (± 0.16%) | +0.64s (+ 0.44%) | 144.69s | 145.32s | p=0.005 n=6 |
| webpack - node (v18.15.0, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 275,352 | 275,352 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 112,436 | 112,436 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 424,181k (± 0.01%) | 430,888k (± 0.02%) | +6,707k (+ 1.58%) | 430,811k | 431,057k | p=0.005 n=6 |
| Parse Time | 4.91s (± 0.31%) | 5.05s (± 0.48%) | +0.14s (+ 2.85%) | 5.02s | 5.09s | p=0.005 n=6 |
| Bind Time | 2.12s (± 0.35%) | 2.11s (± 0.57%) | ~ | 2.10s | 2.13s | p=0.240 n=6 |
| Check Time | 21.60s (± 0.38%) | 21.77s (± 0.31%) | +0.17s (+ 0.80%) | 21.70s | 21.88s | p=0.005 n=6 |
| Emit Time | 0.00s | 0.00s | ~ | ~ | ~ | p=1.000 n=6 |
| Total Time | 28.63s (± 0.30%) | 28.94s (± 0.22%) | +0.31s (+ 1.07%) | 28.86s | 29.04s | p=0.005 n=6 |
| xstate-main - node (v18.15.0, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 534,188 | 534,188 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 176,207 | 176,207 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 479,285k (± 0.01%) | 486,189k (± 0.01%) | +6,904k (+ 1.44%) | 486,122k | 486,249k | p=0.005 n=6 |
| Parse Time | 2.82s (± 0.47%) | 2.90s (± 0.29%) | +0.08s (+ 2.95%) | 2.89s | 2.91s | p=0.004 n=6 |
| Bind Time | 1.05s (± 0.99%) | 1.05s (± 1.00%) | ~ | 1.03s | 1.06s | p=0.801 n=6 |
| Check Time | 15.21s (± 0.30%) | 15.23s (± 0.56%) | ~ | 15.11s | 15.36s | p=0.575 n=6 |
| Emit Time | 0.00s | 0.00s | ~ | ~ | ~ | p=1.000 n=6 |
| Total Time | 19.08s (± 0.29%) | 19.18s (± 0.44%) | ~ | 19.06s | 19.31s | p=0.065 n=6 |
System info unknown
Hosts
- node (v18.15.0, x64)
Scenarios
- Compiler-Unions - node (v18.15.0, x64)
- angular-1 - node (v18.15.0, x64)
- mui-docs - node (v18.15.0, x64)
- self-build-src - node (v18.15.0, x64)
- self-build-src-public-api - node (v18.15.0, x64)
- self-compiler - node (v18.15.0, x64)
- ts-pre-modules - node (v18.15.0, x64)
- vscode - node (v18.15.0, x64)
- webpack - node (v18.15.0, x64)
- xstate-main - node (v18.15.0, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Developer Information:
@jakebailey The results of the perf run you requested are in!
Here they are:
tsc
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Compiler-Unions - bun (v1.1.24, x64) | ||||||
| Errors | 30 | 30 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 62,153 | 62,153 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 50,242 | 50,242 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 257,819k (± 2.31%) | 252,103k (± 4.55%) | ~ | 241,886k | 266,834k | p=0.471 n=6 |
| Parse Time | 1.73s (± 3.92%) | 1.73s (± 1.40%) | ~ | 1.71s | 1.77s | p=0.627 n=6 |
| Bind Time | 1.28s (± 2.49%) | 1.28s (± 1.68%) | ~ | 1.25s | 1.31s | p=0.466 n=6 |
| Check Time | 13.71s (± 0.63%) | 14.54s (± 0.78%) | 🔻+0.83s (+ 6.06%) | 14.40s | 14.67s | p=0.005 n=6 |
| Emit Time | 4.27s (± 2.89%) | 4.32s (± 2.33%) | ~ | 4.18s | 4.44s | p=0.422 n=6 |
| Total Time | 20.99s (± 0.49%) | 21.88s (± 0.40%) | 🔻+0.89s (+ 4.22%) | 21.81s | 22.05s | p=0.005 n=6 |
| angular-1 - bun (v1.1.24, x64) | ||||||
| Errors | 7 | 7 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 945,757 | 945,757 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 410,067 | 410,067 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 1,410,611k (± 0.48%) | 1,381,891k (± 0.14%) | -28,720k (- 2.04%) | 1,379,545k | 1,384,376k | p=0.005 n=6 |
| Parse Time | 4.94s (± 0.46%) | 5.13s (± 0.65%) | +0.18s (+ 3.74%) | 5.10s | 5.19s | p=0.005 n=6 |
| Bind Time | 2.12s (± 1.38%) | 2.18s (± 0.80%) | +0.06s (+ 2.91%) | 2.16s | 2.21s | p=0.015 n=6 |
| Check Time | 30.83s (± 0.26%) | 32.19s (± 0.51%) | 🔻+1.36s (+ 4.41%) | 32.00s | 32.45s | p=0.005 n=6 |
| Emit Time | 12.83s (± 0.56%) | 12.91s (± 0.53%) | ~ | 12.83s | 13.03s | p=0.125 n=6 |
| Total Time | 50.72s (± 0.09%) | 52.41s (± 0.33%) | +1.68s (+ 3.31%) | 52.18s | 52.63s | p=0.005 n=6 |
| mui-docs - bun (v1.1.24, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 2,505,734 | 2,505,734 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 993,039 | 993,039 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 3,851,478k (± 0.32%) | 3,742,554k (± 0.28%) | -108,924k (- 2.83%) | 3,736,853k | 3,763,292k | p=0.005 n=6 |
| Parse Time | 8.98s (± 0.38%) | 9.19s (± 0.31%) | +0.21s (+ 2.34%) | 9.17s | 9.23s | p=0.005 n=6 |
| Bind Time | 2.87s (± 1.47%) | 2.91s (± 1.21%) | ~ | 2.85s | 2.95s | p=0.125 n=6 |
| Check Time | 83.20s (± 0.43%) | 82.75s (± 0.73%) | ~ | 81.65s | 83.31s | p=0.230 n=6 |
| Emit Time | 0.39s (± 2.07%) | 0.38s (± 1.35%) | -0.01s (- 2.54%) | 0.38s | 0.39s | p=0.022 n=6 |
| Total Time | 95.45s (± 0.43%) | 95.24s (± 0.63%) | ~ | 94.12s | 95.73s | p=0.810 n=6 |
| self-build-src - bun (v1.1.24, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 1,231,417 | 1,241,520 | +10,103 (+ 0.82%) | ~ | ~ | p=0.001 n=6 |
| Types | 264,363 | 264,401 | +38 (+ 0.01%) | ~ | ~ | p=0.001 n=6 |
| Memory used | 6,606,992k (±27.46%) | 5,878,751k (±35.44%) | ~ | 4,492,104k | 9,964,643k | p=0.128 n=6 |
| Parse Time | 5.86s (± 1.27%) | 6.03s (± 1.81%) | +0.17s (+ 2.93%) | 5.87s | 6.13s | p=0.036 n=6 |
| Bind Time | 2.67s (± 2.43%) | 2.87s (± 4.35%) | 🔻+0.20s (+ 7.36%) | 2.75s | 3.11s | p=0.008 n=6 |
| Check Time | 54.11s (± 2.74%) | 52.15s (± 4.93%) | ~ | 47.64s | 55.61s | p=0.230 n=6 |
| Emit Time | 4.58s (± 3.40%) | 4.01s (± 6.28%) | 🟩-0.57s (-12.38%) | 3.61s | 4.36s | p=0.008 n=6 |
| Total Time | 67.23s (± 2.27%) | 65.07s (± 4.34%) | ~ | 59.97s | 68.62s | p=0.230 n=6 |
| self-build-src-public-api - bun (v1.1.24, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 1,231,417 | 1,241,520 | +10,103 (+ 0.82%) | ~ | ~ | p=0.001 n=6 |
| Types | 264,363 | 264,401 | +38 (+ 0.01%) | ~ | ~ | p=0.001 n=6 |
| Memory used | 4,828,852k (± 6.67%) | 5,932,364k (±32.45%) | ~ | 4,643,578k | 9,692,287k | p=0.378 n=6 |
| Parse Time | 4.14s (± 1.84%) | 4.14s (± 1.45%) | ~ | 4.05s | 4.20s | p=1.000 n=6 |
| Bind Time | 1.97s (± 1.39%) | 1.95s (± 1.63%) | ~ | 1.91s | 1.98s | p=0.470 n=6 |
| Check Time | 38.26s (± 2.34%) | 37.55s (± 3.67%) | ~ | 35.69s | 38.80s | p=0.936 n=6 |
| Emit Time | 2.76s (± 1.91%) | 2.73s (± 4.03%) | ~ | 2.55s | 2.89s | p=0.575 n=6 |
| Total Time | 47.11s (± 2.14%) | 46.36s (± 3.20%) | ~ | 44.24s | 47.70s | p=0.936 n=6 |
| self-compiler - bun (v1.1.24, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 256,907 | 256,907 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 105,594 | 105,594 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 452,129k (± 1.58%) | 456,035k (± 0.13%) | ~ | 455,248k | 456,768k | p=0.066 n=6 |
| Parse Time | 3.45s (± 1.18%) | 3.58s (± 0.58%) | 🔻+0.14s (+ 4.01%) | 3.55s | 3.61s | p=0.005 n=6 |
| Bind Time | 1.77s (± 3.38%) | 1.75s (± 2.41%) | ~ | 1.71s | 1.81s | p=0.574 n=6 |
| Check Time | 22.67s (± 0.68%) | 22.79s (± 1.28%) | ~ | 22.52s | 23.18s | p=0.575 n=6 |
| Emit Time | 2.01s (± 4.36%) | 2.13s (± 4.60%) | ~ | 2.02s | 2.25s | p=0.093 n=6 |
| Total Time | 29.89s (± 0.75%) | 30.25s (± 0.91%) | +0.36s (+ 1.22%) | 30.06s | 30.75s | p=0.030 n=6 |
| ts-pre-modules - bun (v1.1.24, x64) | ||||||
| Errors | 35 | 35 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 225,018 | 225,018 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 94,245 | 94,245 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 390,024k (± 0.12%) | 389,067k (± 0.22%) | ~ | 388,109k | 390,162k | p=0.066 n=6 |
| Parse Time | 1.97s (± 1.35%) | 2.02s (± 0.41%) | +0.05s (+ 2.53%) | 2.01s | 2.03s | p=0.005 n=6 |
| Bind Time | 1.32s (± 2.12%) | 1.35s (± 2.33%) | ~ | 1.30s | 1.39s | p=0.259 n=6 |
| Check Time | 13.78s (± 1.37%) | 14.15s (± 0.58%) | +0.37s (+ 2.70%) | 14.05s | 14.23s | p=0.005 n=6 |
| Emit Time | 0.00s | 0.00s | ~ | ~ | ~ | p=1.000 n=6 |
| Total Time | 17.08s (± 1.02%) | 17.52s (± 0.58%) | +0.44s (+ 2.59%) | 17.37s | 17.63s | p=0.005 n=6 |
| vscode - bun (v1.1.24, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 3,006,618 | 3,006,618 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 1,035,512 | 1,035,512 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 3,683,811k (± 0.04%) | 3,607,804k (± 0.15%) | -76,007k (- 2.06%) | 3,602,134k | 3,614,629k | p=0.005 n=6 |
| Parse Time | 9.46s (± 0.37%) | 9.77s (± 0.25%) | +0.31s (+ 3.22%) | 9.74s | 9.81s | p=0.005 n=6 |
| Bind Time | 4.19s (± 0.59%) | 4.27s (± 1.20%) | +0.08s (+ 2.03%) | 4.21s | 4.33s | p=0.013 n=6 |
| Check Time | 59.47s (± 0.22%) | 60.54s (± 0.27%) | +1.07s (+ 1.80%) | 60.25s | 60.69s | p=0.005 n=6 |
| Emit Time | 15.94s (± 0.37%) | 15.70s (± 0.42%) | -0.24s (- 1.51%) | 15.63s | 15.79s | p=0.005 n=6 |
| Total Time | 89.05s (± 0.21%) | 90.29s (± 0.11%) | +1.23s (+ 1.38%) | 90.15s | 90.39s | p=0.005 n=6 |
| webpack - bun (v1.1.24, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 275,352 | 275,352 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 112,436 | 112,436 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 496,716k (± 0.20%) | 499,230k (± 0.48%) | ~ | 494,868k | 501,751k | p=0.066 n=6 |
| Parse Time | 3.39s (± 1.29%) | 3.35s (± 0.88%) | ~ | 3.31s | 3.39s | p=0.172 n=6 |
| Bind Time | 1.65s (± 2.68%) | 1.73s (± 1.44%) | 🔻+0.09s (+ 5.26%) | 1.71s | 1.78s | p=0.005 n=6 |
| Check Time | 16.11s (± 0.80%) | 16.43s (± 0.30%) | +0.33s (+ 2.03%) | 16.36s | 16.51s | p=0.005 n=6 |
| Emit Time | 0.00s | 0.00s | ~ | ~ | ~ | p=1.000 n=6 |
| Total Time | 21.15s (± 0.59%) | 21.53s (± 0.36%) | +0.38s (+ 1.79%) | 21.39s | 21.62s | p=0.005 n=6 |
| xstate-main - bun (v1.1.24, x64) | ||||||
| Errors | 0 | 0 | ~ | ~ | ~ | p=1.000 n=6 |
| Symbols | 534,188 | 534,188 | ~ | ~ | ~ | p=1.000 n=6 |
| Types | 176,207 | 176,207 | ~ | ~ | ~ | p=1.000 n=6 |
| Memory used | 564,294k (± 2.73%) | 567,111k (± 1.42%) | ~ | 552,932k | 578,090k | p=0.575 n=6 |
| Parse Time | 2.93s (± 1.15%) | 3.04s (± 1.35%) | +0.11s (+ 3.64%) | 2.98s | 3.10s | p=0.005 n=6 |
| Bind Time | 1.33s (± 2.57%) | 1.25s (± 4.87%) | 🟩-0.08s (- 6.26%) | 1.15s | 1.32s | p=0.030 n=6 |
| Check Time | 17.10s (± 0.45%) | 17.36s (± 0.95%) | +0.26s (+ 1.51%) | 17.14s | 17.55s | p=0.012 n=6 |
| Emit Time | 0.00s (±244.70%) | 0.00s (±244.70%) | ~ | 0.00s | 0.01s | p=1.000 n=6 |
| Total Time | 21.38s (± 0.41%) | 21.66s (± 0.74%) | +0.28s (+ 1.32%) | 21.48s | 21.85s | p=0.005 n=6 |
System info unknown
Hosts
- bun (v1.1.24, x64)
Scenarios
- Compiler-Unions - bun (v1.1.24, x64)
- angular-1 - bun (v1.1.24, x64)
- mui-docs - bun (v1.1.24, x64)
- self-build-src - bun (v1.1.24, x64)
- self-build-src-public-api - bun (v1.1.24, x64)
- self-compiler - bun (v1.1.24, x64)
- ts-pre-modules - bun (v1.1.24, x64)
- vscode - bun (v1.1.24, x64)
- webpack - bun (v1.1.24, x64)
- xstate-main - bun (v1.1.24, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |