benchmark icon indicating copy to clipboard operation
benchmark copied to clipboard

TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.

Results 259 benchmark issues
Sort by recently updated
recently updated
newest added

some models implement by preparing data, .cuda() etc. in __init__ and do the bare minimum 'inner loop' in train()/eval() - this plays nicely with the benchmark setup. Other models may...

Hi, First, I want to thank you guys for sharing the code. I learned a lot from it. It gives me a good start for implement my own GRU layer....

Dear PyTorch team, Recently I tried out these versions of LSTMs with layer normalization, that I found through the PyTorch forums. Using the **script_lnlstm** with layer normalization however, causes the...

I got this error, but i'm not able to find where the error come from. ``` File "lstm_test.py", line 300, in test_script_stacked_bidir_rnn(5, 2, 3, 7, 4) File "lstm_test.py", line 275,...

Modify config files and setup_env to perform 1.13.0 pytorch release benchmark test

cla signed

Previously, we would launch a different slurm job for measurement, e.g.: 1) resnet50 w/ inductor + graph breaks, 2 node 2) resnet50 w/ inductor + NO graph breaks, 2 node...

cla signed

Stack from [ghstack](https://github.com/ezyang/ghstack): * __->__ #1243 Many of the models are fairly large, and 10 iterations is way too much (chrometrace take sa long time to load and freezes). 2...

cla signed

TorchBench CI has detected a performance signal. Base PyTorch version: 1.14.0.dev20221009+cu116 Base PyTorch commit: 92ac84c98a19310885f3d818aba56b981940d615 Affected PyTorch version: 1.14.0.dev20221011+cu116 Affected PyTorch commit: ad2b04c39c41949d8869de743736bcaeec2dfa0d Affected Tests: - test_eval[mnasnet1_0-cpu-jit]: +7.04205% - test_eval[mobilenet_v2_quantized_qat-cpu-jit]:...

torchbench-perf-report