microsoft
ignore me, testing build stuff
Heya @jakebailey, I've started to run the tarball bundle task on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:
{
"devDependencies": {
"typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156239/artifacts?artifactName=tgz&fileId=9C693591393572DE27206905AC214EF7A645084F8DDDED5392E1E9AD1EAB369502&fileName=/typescript-5.2.0-insiders.20230804.tgz"
}
}
and then running npm install.
There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;
Heya @jakebailey, I've started to run the tarball bundle task on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:
{
"devDependencies": {
"typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156240/artifacts?artifactName=tgz&fileId=9C693591393572DE27206905AC214EF7A645084F8DDDED5392E1E9AD1EAB369502&fileName=/typescript-5.2.0-insiders.20230804.tgz"
}
}
and then running npm install.
There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;
Heya @jakebailey, I've started to run the tarball bundle task on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Hey @jakebailey, I've packed this into an installable tgz. You can install it for testing by referencing it in your package.json like so:
{
"devDependencies": {
"typescript": "https://typescript.visualstudio.com/cf7ac146-d525-443c-b23c-0d58337efebc/_apis/build/builds/156246/artifacts?artifactName=tgz&fileId=1C81B256BB8001203E5CD3EF144ABC97CC87E40C0F26A924F925228CFC60433002&fileName=/typescript-5.2.0-insiders.20230804.tgz"
}
}
and then running npm install.
There is also a playground for this build and an npm module you can use via "typescript": "npm:@typescript-deploys/[email protected]".;
Heya @jakebailey, I've started to run the bun perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Update: The results are in!
@jakebailey The results of the perf run you requested are in!
Here they are:
Compiler
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Angular - bun (v0.7.3, x64) | ||||||
| Memory used | 322,062k (± 0.30%) | 322,686k (± 0.13%) | ~ | 322,195k | 323,191k | p=0.230 n=6 |
| Parse Time | 2.32s (± 1.18%) | 2.33s (± 1.12%) | ~ | 2.31s | 2.38s | p=0.145 n=6 |
| Bind Time | 0.98s (± 6.25%) | 0.96s (± 5.47%) | ~ | 0.87s | 1.02s | p=0.470 n=6 |
| Check Time | 7.88s (± 1.52%) | 7.94s (± 2.39%) | ~ | 7.75s | 8.17s | p=0.873 n=6 |
| Emit Time | 6.43s (± 1.15%) | 6.46s (± 0.76%) | ~ | 6.40s | 6.53s | p=0.873 n=6 |
| Total Time | 17.61s (± 0.69%) | 17.68s (± 0.82%) | ~ | 17.54s | 17.84s | p=0.628 n=6 |
| Compiler-Unions - bun (v0.7.3, x64) | ||||||
| Memory used | 243,101k (± 2.27%) | 243,636k (± 2.78%) | ~ | 240,454k | 257,425k | p=0.689 n=6 |
| Parse Time | 1.27s (± 1.89%) | 1.26s (± 0.44%) | ~ | 1.25s | 1.26s | p=0.236 n=6 |
| Bind Time | 0.85s (± 1.73%) | 0.85s (± 1.88%) | ~ | 0.83s | 0.88s | p=0.933 n=6 |
| Check Time | 8.92s (± 0.46%) | 8.91s (± 0.48%) | ~ | 8.87s | 8.98s | p=0.808 n=6 |
| Emit Time | 2.75s (± 1.42%) | 2.76s (± 0.99%) | ~ | 2.73s | 2.80s | p=0.936 n=6 |
| Total Time | 13.80s (± 0.59%) | 13.77s (± 0.50%) | ~ | 13.70s | 13.89s | p=0.520 n=6 |
| Monaco - bun (v0.7.3, x64) | ||||||
| Memory used | 369,778k (± 0.25%) | 370,498k (± 0.31%) | ~ | 369,470k | 372,221k | p=0.066 n=6 |
| Parse Time | 2.05s (± 0.48%) | 2.06s (± 0.27%) | ~ | 2.05s | 2.06s | p=0.201 n=6 |
| Bind Time | 1.08s (± 1.48%) | 1.09s (± 1.58%) | ~ | 1.07s | 1.11s | p=0.452 n=6 |
| Check Time | 7.20s (± 0.55%) | 7.16s (± 0.87%) | ~ | 7.07s | 7.24s | p=0.149 n=6 |
| Emit Time | 3.80s (± 1.40%) | 3.74s (± 0.55%) | -0.06s (- 1.49%) | 3.72s | 3.77s | p=0.044 n=6 |
| Total Time | 14.13s (± 0.41%) | 14.04s (± 0.38%) | -0.09s (- 0.66%) | 13.99s | 14.13s | p=0.020 n=6 |
| TFS - bun (v0.7.3, x64) | ||||||
| Memory used | 318,031k (± 0.16%) | 318,090k (± 0.47%) | ~ | 316,497k | 320,296k | p=0.936 n=6 |
| Parse Time | 1.80s (± 1.40%) | 1.80s (± 1.04%) | ~ | 1.79s | 1.84s | p=0.357 n=6 |
| Bind Time | 1.00s (± 0.63%) | 0.98s (± 2.69%) | ~ | 0.93s | 1.00s | p=0.070 n=6 |
| Check Time | 6.64s (± 0.54%) | 6.64s (± 0.19%) | ~ | 6.62s | 6.66s | p=1.000 n=6 |
| Emit Time | 3.48s (± 1.15%) | 3.46s (± 0.88%) | ~ | 3.42s | 3.51s | p=0.373 n=6 |
| Total Time | 12.92s (± 0.50%) | 12.89s (± 0.24%) | ~ | 12.85s | 12.93s | p=0.376 n=6 |
| material-ui - bun (v0.7.3, x64) | ||||||
| Memory used | 511,825k (± 5.43%) | 522,497k (± 4.24%) | ~ | 488,592k | 537,875k | p=0.689 n=6 |
| Parse Time | 2.50s (± 0.55%) | 2.50s (± 2.14%) | ~ | 2.44s | 2.59s | p=0.465 n=6 |
| Bind Time | 0.71s (± 0.58%) | 0.73s (± 4.86%) | ~ | 0.71s | 0.80s | p=0.056 n=6 |
| Check Time | 15.75s (± 0.28%) | 15.81s (± 0.54%) | ~ | 15.70s | 15.96s | p=0.169 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.01s (±154.76%) | ~ | 0.00s | 0.02s | p=0.174 n=6 |
| Total Time | 18.96s (± 0.21%) | 19.04s (± 0.56%) | ~ | 18.94s | 19.22s | p=0.092 n=6 |
| xstate - bun (v0.7.3, x64) | ||||||
| Memory used | 407,574k (± 9.08%) | 446,225k (±13.05%) | ~ | 358,909k | 512,993k | p=0.471 n=6 |
| Parse Time | 3.56s (± 0.75%) | 3.59s (± 0.56%) | ~ | 3.57s | 3.62s | p=0.063 n=6 |
| Bind Time | 1.38s (± 1.77%) | 1.38s (± 2.79%) | ~ | 1.30s | 1.41s | p=0.687 n=6 |
| Check Time | 3.54s (± 0.39%) | 3.55s (± 1.03%) | ~ | 3.51s | 3.60s | p=0.871 n=6 |
| Emit Time | 0.21s (± 3.01%) | 0.21s (± 1.96%) | ~ | 0.20s | 0.21s | p=0.673 n=6 |
| Total Time | 8.70s (± 0.40%) | 8.72s (± 0.60%) | ~ | 8.66s | 8.80s | p=0.936 n=6 |
- bun (v0.7.3, x64)
- Angular - bun (v0.7.3, x64)
- Compiler-Unions - bun (v0.7.3, x64)
- Monaco - bun (v0.7.3, x64)
- TFS - bun (v0.7.3, x64)
- material-ui - bun (v0.7.3, x64)
- xstate - bun (v0.7.3, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Startup
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| tsc-startup - bun (v0.7.3, x64) | ||||||
| Execution time | 425.46ms (± 0.06%) | 424.89ms (± 0.11%) | -0.57ms (- 0.13%) | 423.67ms | 433.14ms | p=0.000 n=600 |
| tsserverlibrary-startup - bun (v0.7.3, x64) | ||||||
| Execution time | 661.73ms (± 0.15%) | 661.61ms (± 0.14%) | -0.12ms (- 0.02%) | 659.60ms | 677.41ms | p=0.027 n=600 |
| typescript-startup - bun (v0.7.3, x64) | ||||||
| Execution time | 662.41ms (± 0.15%) | 661.94ms (± 0.15%) | -0.47ms (- 0.07%) | 660.03ms | 691.02ms | p=0.000 n=600 |
- bun (v0.7.3, x64)
- tsc-startup - bun (v0.7.3, x64)
- tsserverlibrary-startup - bun (v0.7.3, x64)
- typescript-startup - bun (v0.7.3, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Developer Information:
Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Update: The results are in!
Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Update: The results are in!
@jakebailey The results of the perf run you requested are in!
Here they are:
Compiler
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Angular - vscode (1.81.1, x64) | ||||||
| Memory used | 239,805k (± 0.82%) | 239,806k (± 0.82%) | ~ | 235,812k | 240,701k | p=0.936 n=6 |
| Parse Time | 2.95s (± 0.94%) | 2.96s (± 0.51%) | ~ | 2.94s | 2.98s | p=0.511 n=6 |
| Bind Time | 1.00s (± 1.03%) | 1.00s (± 0.75%) | ~ | 0.99s | 1.01s | p=0.931 n=6 |
| Check Time | 7.84s (± 0.15%) | 7.85s (± 0.25%) | ~ | 7.82s | 7.87s | p=0.625 n=6 |
| Emit Time | 7.20s (± 0.50%) | 7.17s (± 0.42%) | ~ | 7.14s | 7.21s | p=0.195 n=6 |
| Total Time | 19.00s (± 0.29%) | 18.98s (± 0.22%) | ~ | 18.92s | 19.04s | p=0.687 n=6 |
| Compiler-Unions - vscode (1.81.1, x64) | ||||||
| Memory used | 168,685k (± 2.27%) | 168,533k (± 2.45%) | ~ | 160,819k | 171,691k | p=0.936 n=6 |
| Parse Time | 1.58s (± 1.79%) | 1.57s (± 3.62%) | ~ | 1.48s | 1.63s | p=0.872 n=6 |
| Bind Time | 0.76s (± 0.99%) | 0.75s (± 1.82%) | ~ | 0.74s | 0.77s | p=0.740 n=6 |
| Check Time | 8.69s (± 0.46%) | 8.72s (± 0.62%) | ~ | 8.65s | 8.81s | p=0.376 n=6 |
| Emit Time | 2.60s (± 0.91%) | 2.61s (± 1.07%) | ~ | 2.58s | 2.66s | p=0.418 n=6 |
| Total Time | 13.63s (± 0.45%) | 13.66s (± 0.65%) | ~ | 13.55s | 13.78s | p=0.629 n=6 |
| Monaco - vscode (1.81.1, x64) | ||||||
| Memory used | 243,869k (± 0.19%) | 246,109k (± 1.05%) | ~ | 243,640k | 250,168k | p=0.066 n=6 |
| Parse Time | 2.60s (± 1.16%) | 2.64s (± 2.64%) | ~ | 2.58s | 2.73s | p=0.296 n=6 |
| Bind Time | 1.11s (± 1.23%) | 1.06s (± 8.39%) | ~ | 0.94s | 1.14s | p=0.805 n=6 |
| Check Time | 6.86s (± 0.54%) | 6.80s (± 0.46%) | -0.06s (- 0.87%) | 6.75s | 6.83s | p=0.023 n=6 |
| Emit Time | 3.91s (± 0.30%) | 3.91s (± 0.43%) | ~ | 3.89s | 3.94s | p=0.933 n=6 |
| Total Time | 14.47s (± 0.33%) | 14.41s (± 0.33%) | ~ | 14.34s | 14.47s | p=0.064 n=6 |
| TFS - vscode (1.81.1, x64) | ||||||
| Memory used | 196,282k (± 0.31%) | 196,791k (± 0.22%) | ~ | 196,254k | 197,224k | p=0.093 n=6 |
| Parse Time | 2.08s (± 0.56%) | 2.08s (± 0.90%) | ~ | 2.06s | 2.11s | p=0.807 n=6 |
| Bind Time | 1.02s (± 7.47%) | 0.97s (± 7.71%) | ~ | 0.90s | 1.04s | p=0.062 n=6 |
| Check Time | 6.18s (± 1.04%) | 6.22s (± 1.59%) | ~ | 6.12s | 6.34s | p=0.628 n=6 |
| Emit Time | 3.77s (± 1.80%) | 3.76s (± 2.00%) | ~ | 3.61s | 3.82s | p=0.515 n=6 |
| Total Time | 13.06s (± 0.49%) | 13.04s (± 0.69%) | ~ | 12.89s | 13.16s | p=0.936 n=6 |
| material-ui - vscode (1.81.1, x64) | ||||||
| Memory used | 303,145k (± 0.86%) | 296,493k (± 4.26%) | ~ | 271,371k | 304,638k | p=0.128 n=6 |
| Parse Time | 3.22s (± 1.27%) | 3.19s (± 1.39%) | ~ | 3.13s | 3.24s | p=0.418 n=6 |
| Bind Time | 0.92s (± 0.82%) | 0.95s (± 5.73%) | ~ | 0.90s | 1.02s | p=0.682 n=6 |
| Check Time | 15.78s (± 0.74%) | 15.81s (± 1.00%) | ~ | 15.63s | 16.09s | p=1.000 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 19.93s (± 0.73%) | 19.95s (± 0.82%) | ~ | 19.80s | 20.25s | p=1.000 n=6 |
| xstate - vscode (1.81.1, x64) | ||||||
| Memory used | 367,863k (± 0.88%) | 368,740k (± 0.67%) | ~ | 365,164k | 371,246k | p=0.810 n=6 |
| Parse Time | 3.83s (± 0.79%) | 3.83s (± 0.88%) | ~ | 3.77s | 3.87s | p=0.629 n=6 |
| Bind Time | 1.34s (± 1.61%) | 1.34s (± 1.33%) | ~ | 1.32s | 1.37s | p=0.745 n=6 |
| Check Time | 2.87s (± 0.58%) | 2.87s (± 0.90%) | ~ | 2.82s | 2.89s | p=1.000 n=6 |
| Emit Time | 0.13s (± 3.87%) | 0.14s (± 5.97%) | ~ | 0.13s | 0.15s | p=0.652 n=6 |
| Total Time | 8.18s (± 0.59%) | 8.18s (± 0.39%) | ~ | 8.13s | 8.22s | p=0.872 n=6 |
- vscode (1.81.1, x64)
- Angular - vscode (1.81.1, x64)
- Compiler-Unions - vscode (1.81.1, x64)
- Monaco - vscode (1.81.1, x64)
- TFS - vscode (1.81.1, x64)
- material-ui - vscode (1.81.1, x64)
- xstate - vscode (1.81.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
tsserver
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Compiler-UnionsTSServer - vscode (1.81.1, x64) | ||||||
| Req 1 - updateOpen | 2,488ms (± 0.43%) | 2,451ms (± 0.95%) | -38ms (- 1.51%) | 2,423ms | 2,480ms | p=0.013 n=6 |
| Req 2 - geterr | 5,307ms (± 1.55%) | 5,334ms (± 1.99%) | ~ | 5,139ms | 5,415ms | p=0.423 n=6 |
| Req 3 - references | 362ms (± 2.34%) | 356ms (± 2.70%) | ~ | 337ms | 363ms | p=0.872 n=6 |
| Req 4 - navto | 307ms (± 4.39%) | 317ms (± 3.58%) | ~ | 300ms | 334ms | p=0.229 n=6 |
| Req 5 - completionInfo count | 1,356 (± 0.00%) | 1,356 (± 0.00%) | ~ | 1,356 | 1,356 | p=1.000 n=6 |
| Req 5 - completionInfo | 95ms (±10.73%) | 95ms (± 5.80%) | ~ | 90ms | 102ms | p=0.809 n=6 |
| CompilerTSServer - vscode (1.81.1, x64) | ||||||
| Req 1 - updateOpen | 2,621ms (± 0.96%) | 2,625ms (± 1.44%) | ~ | 2,557ms | 2,668ms | p=0.471 n=6 |
| Req 2 - geterr | 3,871ms (± 0.55%) | 3,866ms (± 0.36%) | ~ | 3,843ms | 3,885ms | p=0.748 n=6 |
| Req 3 - references | 366ms (± 2.12%) | 365ms (± 2.22%) | ~ | 354ms | 377ms | p=0.873 n=6 |
| Req 4 - navto | 295ms (± 3.75%) | 301ms (± 2.65%) | ~ | 287ms | 310ms | p=0.520 n=6 |
| Req 5 - completionInfo count | 1,518 (± 0.00%) | 1,518 (± 0.00%) | ~ | 1,518 | 1,518 | p=1.000 n=6 |
| Req 5 - completionInfo | 92ms (± 7.05%) | 91ms (± 5.61%) | ~ | 81ms | 95ms | p=0.683 n=6 |
| xstateTSServer - vscode (1.81.1, x64) | ||||||
| Req 1 - updateOpen | 2,736ms (± 1.09%) | 2,728ms (± 1.18%) | ~ | 2,674ms | 2,757ms | p=0.936 n=6 |
| Req 2 - geterr | 1,586ms (± 2.58%) | 1,583ms (± 1.37%) | ~ | 1,565ms | 1,622ms | p=0.936 n=6 |
| Req 3 - references | 121ms (± 4.41%) | 123ms (± 5.74%) | ~ | 115ms | 135ms | p=0.936 n=6 |
| Req 4 - navto | 381ms (± 2.79%) | 376ms (± 1.58%) | ~ | 365ms | 381ms | p=0.575 n=6 |
| Req 5 - completionInfo count | 2,071 (± 0.00%) | 2,071 (± 0.00%) | ~ | 2,071 | 2,071 | p=1.000 n=6 |
| Req 5 - completionInfo | 364ms (± 9.38%) | 361ms (± 5.19%) | ~ | 340ms | 386ms | p=0.936 n=6 |
- vscode (1.81.1, x64)
- CompilerTSServer - vscode (1.81.1, x64)
- Compiler-UnionsTSServer - vscode (1.81.1, x64)
- xstateTSServer - vscode (1.81.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Startup
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| tsc-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 206.85ms (± 0.11%) | 206.79ms (± 0.23%) | -0.06ms (- 0.03%) | 205.72ms | 226.61ms | p=0.000 n=600 |
| tsserver-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 296.47ms (± 0.09%) | 296.43ms (± 0.19%) | -0.04ms (- 0.01%) | 295.40ms | 319.17ms | p=0.000 n=600 |
| tsserverlibrary-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 285.99ms (± 0.09%) | 286.00ms (± 0.12%) | ~ | 284.74ms | 297.62ms | p=0.901 n=600 |
| typescript-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 285.65ms (± 0.09%) | 285.74ms (± 0.11%) | +0.09ms (+ 0.03%) | 284.58ms | 295.84ms | p=0.000 n=600 |
- vscode (1.81.1, x64)
- tsc-startup - vscode (1.81.1, x64)
- tsserver-startup - vscode (1.81.1, x64)
- tsserverlibrary-startup - vscode (1.81.1, x64)
- typescript-startup - vscode (1.81.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Developer Information:
Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Update: The results are in!
@jakebailey The results of the perf run you requested are in!
Here they are:
Compiler
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Angular - vscode (1.81.1, x64) | ||||||
| Memory used | 233,325k (± 5.13%) | 229,486k (± 9.40%) | ~ | 185,585k | 240,549k | p=0.936 n=6 |
| Parse Time | 2.96s (± 0.50%) | 2.96s (± 0.97%) | ~ | 2.92s | 3.00s | p=0.460 n=6 |
| Bind Time | 1.01s (± 1.02%) | 1.01s (± 0.74%) | ~ | 1.00s | 1.02s | p=0.348 n=6 |
| Check Time | 7.86s (± 0.50%) | 7.87s (± 0.34%) | ~ | 7.84s | 7.91s | p=0.742 n=6 |
| Emit Time | 7.26s (± 1.51%) | 7.23s (± 1.29%) | ~ | 7.15s | 7.41s | p=0.420 n=6 |
| Total Time | 19.09s (± 0.53%) | 19.08s (± 0.39%) | ~ | 18.97s | 19.18s | p=0.873 n=6 |
| Compiler-Unions - vscode (1.81.1, x64) | ||||||
| Memory used | 168,183k (± 3.75%) | 167,810k (± 2.89%) | ~ | 162,745k | 173,293k | p=1.000 n=6 |
| Parse Time | 1.59s (± 1.62%) | 1.55s (± 2.79%) | ~ | 1.50s | 1.61s | p=0.076 n=6 |
| Bind Time | 0.76s (± 1.74%) | 0.76s (± 1.07%) | ~ | 0.75s | 0.77s | p=0.865 n=6 |
| Check Time | 8.64s (± 0.52%) | 8.67s (± 0.49%) | ~ | 8.59s | 8.71s | p=0.333 n=6 |
| Emit Time | 2.62s (± 3.56%) | 2.71s (± 3.30%) | +0.09s (+ 3.50%) | 2.61s | 2.82s | p=0.036 n=6 |
| Total Time | 13.62s (± 0.70%) | 13.70s (± 0.48%) | ~ | 13.62s | 13.79s | p=0.107 n=6 |
| Monaco - vscode (1.81.1, x64) | ||||||
| Memory used | 244,672k (± 0.75%) | 246,239k (± 1.53%) | ~ | 243,530k | 252,829k | p=0.575 n=6 |
| Parse Time | 2.60s (± 1.45%) | 2.63s (± 3.53%) | ~ | 2.56s | 2.81s | p=0.684 n=6 |
| Bind Time | 1.10s (± 1.70%) | 1.09s (± 6.18%) | ~ | 0.95s | 1.13s | p=0.413 n=6 |
| Check Time | 6.83s (± 0.38%) | 6.84s (± 0.43%) | ~ | 6.80s | 6.88s | p=0.871 n=6 |
| Emit Time | 3.92s (± 0.53%) | 3.90s (± 0.51%) | ~ | 3.87s | 3.93s | p=0.195 n=6 |
| Total Time | 14.44s (± 0.24%) | 14.45s (± 0.40%) | ~ | 14.34s | 14.50s | p=0.569 n=6 |
| TFS - vscode (1.81.1, x64) | ||||||
| Memory used | 196,895k (± 0.60%) | 197,331k (± 0.81%) | ~ | 195,558k | 199,286k | p=0.936 n=6 |
| Parse Time | 2.10s (± 1.15%) | 2.08s (± 0.59%) | ~ | 2.07s | 2.10s | p=0.100 n=6 |
| Bind Time | 0.98s (± 8.30%) | 0.97s (± 8.09%) | ~ | 0.90s | 1.06s | p=1.000 n=6 |
| Check Time | 6.20s (± 1.24%) | 6.19s (± 1.24%) | ~ | 6.09s | 6.28s | p=1.000 n=6 |
| Emit Time | 3.76s (± 2.37%) | 3.76s (± 2.25%) | ~ | 3.59s | 3.82s | p=0.936 n=6 |
| Total Time | 13.04s (± 0.47%) | 13.01s (± 0.62%) | ~ | 12.87s | 13.10s | p=0.575 n=6 |
| material-ui - vscode (1.81.1, x64) | ||||||
| Memory used | 299,848k (± 0.49%) | 300,180k (± 0.83%) | ~ | 298,024k | 304,273k | p=1.000 n=6 |
| Parse Time | 3.20s (± 1.79%) | 3.21s (± 1.24%) | ~ | 3.14s | 3.24s | p=0.683 n=6 |
| Bind Time | 0.94s (± 4.69%) | 0.95s (± 4.84%) | ~ | 0.91s | 1.01s | p=0.871 n=6 |
| Check Time | 15.72s (± 0.56%) | 15.75s (± 0.34%) | ~ | 15.69s | 15.84s | p=0.687 n=6 |
| Emit Time | 0.00s (± 0.00%) | 0.00s (± 0.00%) | ~ | 0.00s | 0.00s | p=1.000 n=6 |
| Total Time | 19.85s (± 0.28%) | 19.91s (± 0.23%) | ~ | 19.85s | 19.99s | p=0.145 n=6 |
| xstate - vscode (1.81.1, x64) | ||||||
| Memory used | 366,852k (± 0.46%) | 368,018k (± 0.49%) | ~ | 366,165k | 370,179k | p=0.298 n=6 |
| Parse Time | 3.83s (± 0.43%) | 3.84s (± 0.77%) | ~ | 3.79s | 3.87s | p=0.221 n=6 |
| Bind Time | 1.34s (± 0.56%) | 1.34s (± 1.37%) | ~ | 1.32s | 1.37s | p=0.934 n=6 |
| Check Time | 2.87s (± 1.31%) | 2.88s (± 0.81%) | ~ | 2.83s | 2.89s | p=1.000 n=6 |
| Emit Time | 0.13s (± 7.74%) | 0.13s (± 5.71%) | ~ | 0.12s | 0.14s | p=0.864 n=6 |
| Total Time | 8.18s (± 0.73%) | 8.20s (± 0.26%) | ~ | 8.18s | 8.23s | p=0.227 n=6 |
- vscode (1.81.1, x64)
- Angular - vscode (1.81.1, x64)
- Compiler-Unions - vscode (1.81.1, x64)
- Monaco - vscode (1.81.1, x64)
- TFS - vscode (1.81.1, x64)
- material-ui - vscode (1.81.1, x64)
- xstate - vscode (1.81.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
tsserver
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| Compiler-UnionsTSServer - vscode (1.81.1, x64) | ||||||
| Req 1 - updateOpen | 2,467ms (± 0.77%) | 2,487ms (± 1.38%) | ~ | 2,451ms | 2,530ms | p=0.471 n=6 |
| Req 2 - geterr | 5,327ms (± 0.97%) | 5,307ms (± 1.80%) | ~ | 5,212ms | 5,405ms | p=0.810 n=6 |
| Req 3 - references | 359ms (± 1.78%) | 360ms (± 0.54%) | ~ | 357ms | 362ms | p=0.809 n=6 |
| Req 4 - navto | 300ms (± 1.94%) | 301ms (± 1.55%) | ~ | 296ms | 309ms | p=0.809 n=6 |
| Req 5 - completionInfo count | 1,356 (± 0.00%) | 1,356 (± 0.00%) | ~ | 1,356 | 1,356 | p=1.000 n=6 |
| Req 5 - completionInfo | 94ms (± 8.19%) | 98ms (± 6.50%) | ~ | 87ms | 102ms | p=0.454 n=6 |
| CompilerTSServer - vscode (1.81.1, x64) | ||||||
| Req 1 - updateOpen | 2,610ms (± 1.55%) | 2,613ms (± 1.51%) | ~ | 2,549ms | 2,655ms | p=0.810 n=6 |
| Req 2 - geterr | 3,847ms (± 0.66%) | 3,857ms (± 0.93%) | ~ | 3,799ms | 3,909ms | p=0.689 n=6 |
| Req 3 - references | 364ms (± 1.08%) | 370ms (± 0.78%) | +5ms (+ 1.46%) | 367ms | 375ms | p=0.043 n=6 |
| Req 4 - navto | 297ms (± 1.78%) | 293ms (± 2.31%) | ~ | 286ms | 304ms | p=0.286 n=6 |
| Req 5 - completionInfo count | 1,518 (± 0.00%) | 1,518 (± 0.00%) | ~ | 1,518 | 1,518 | p=1.000 n=6 |
| Req 5 - completionInfo | 91ms (± 8.95%) | 96ms (± 1.28%) | ~ | 93ms | 96ms | p=0.228 n=6 |
| xstateTSServer - vscode (1.81.1, x64) | ||||||
| Req 1 - updateOpen | 2,714ms (± 0.34%) | 2,738ms (± 0.96%) | +24ms (+ 0.89%) | 2,707ms | 2,787ms | p=0.045 n=6 |
| Req 2 - geterr | 1,579ms (± 1.59%) | 1,578ms (± 0.97%) | ~ | 1,547ms | 1,590ms | p=0.688 n=6 |
| Req 3 - references | 118ms (± 7.10%) | 118ms (± 5.58%) | ~ | 107ms | 127ms | p=1.000 n=6 |
| Req 4 - navto | 363ms (± 4.40%) | 365ms (± 1.17%) | ~ | 358ms | 370ms | p=1.000 n=6 |
| Req 5 - completionInfo count | 2,071 (± 0.00%) | 2,071 (± 0.00%) | ~ | 2,071 | 2,071 | p=1.000 n=6 |
| Req 5 - completionInfo | 357ms (± 6.12%) | 362ms (± 8.30%) | ~ | 338ms | 416ms | p=0.873 n=6 |
- vscode (1.81.1, x64)
- CompilerTSServer - vscode (1.81.1, x64)
- Compiler-UnionsTSServer - vscode (1.81.1, x64)
- xstateTSServer - vscode (1.81.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Startup
Comparison Report - baseline..pr| Metric | baseline | pr | Delta | Best | Worst | p-value |
|---|---|---|---|---|---|---|
| tsc-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 206.96ms (± 0.11%) | 207.03ms (± 0.10%) | +0.07ms (+ 0.03%) | 206.14ms | 209.35ms | p=0.000 n=600 |
| tsserver-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 296.57ms (± 0.10%) | 296.50ms (± 0.09%) | -0.07ms (- 0.03%) | 295.14ms | 299.54ms | p=0.004 n=600 |
| tsserverlibrary-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 286.19ms (± 0.08%) | 286.19ms (± 0.08%) | ~ | 285.03ms | 288.61ms | p=0.989 n=600 |
| typescript-startup - vscode (1.81.1, x64) | ||||||
| Execution time | 286.07ms (± 0.08%) | 286.09ms (± 0.09%) | ~ | 285.01ms | 289.59ms | p=0.717 n=600 |
- vscode (1.81.1, x64)
- tsc-startup - vscode (1.81.1, x64)
- tsserver-startup - vscode (1.81.1, x64)
- tsserverlibrary-startup - vscode (1.81.1, x64)
- typescript-startup - vscode (1.81.1, x64)
| Benchmark | Name | Iterations |
|---|---|---|
| Current | pr | 6 |
| Baseline | baseline | 6 |
Developer Information:
checking that things worked...
@typescript-bot perf test vscode @typescript-bot perf test bun @typescript-bot perf test this faster @typescript-bot perf test vscode @typescript-bot perf test bun @typescript-bot perf test this faster
Heya @jakebailey, I've started to run the tsc-only perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Heya @jakebailey, I've started to run the bun perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
@typescript-bot perf test this faster @typescript-bot perf test this bun @typescript-bot perf test this vscode
Heya @jakebailey, I've started to run the vscode perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Heya @jakebailey, I've started to run the bun perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.
Heya @jakebailey, I've started to run the tsc-only perf test suite on this PR at 63e8eae4e3b5e6208b761df06060fc19a172d3cb. You can monitor the build here.