hotscript icon indicating copy to clipboard operation
hotscript copied to clipboard

[Feature Request] [Contributions Welcome] Performance benchmarks

Open gvergnaud opened this issue 1 year ago • 4 comments

We should add some tooling to easily compare how changes affect type-checking performance

gvergnaud avatar Feb 13 '23 08:02 gvergnaud

Yes, automating this will require using tsc compiler to :

  • no emit : just typechecking
  • emit : measure impact on real builds
  • maybe also check ts language server timings

I'm not too familiar with ts language server. first two should not pose any challenge

ecyrbe avatar Feb 13 '23 10:02 ecyrbe

This looks very interesting https://github.com/arktypeio/arktype/blob/d90ca63/dev/test/operator.bench.ts

gvergnaud avatar Mar 01 '23 09:03 gvergnaud

I am working on a library that may be helpful https://github.com/webNeat/ts-perf

it's still in beta as I am still experimenting different approaches to it.

My goal is to have a command line that can do the following

$ ts-perf tests/**/*.bench.ts

tests/foo.bench.ts  124ms
tests/bar.bench.ts   241ms
...

webNeat avatar Aug 28 '23 04:08 webNeat

Arktype now has a benchmark tool. This can be useful for tests and benchmarks

g4rcez avatar Jan 19 '24 12:01 g4rcez