benchmark
benchmark copied to clipboard
TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
some models implement by preparing data, .cuda() etc. in __init__ and do the bare minimum 'inner loop' in train()/eval() - this plays nicely with the benchmark setup. Other models may...
Hi, First, I want to thank you guys for sharing the code. I learned a lot from it. It gives me a good start for implement my own GRU layer....
Dear PyTorch team, Recently I tried out these versions of LSTMs with layer normalization, that I found through the PyTorch forums. Using the **script_lnlstm** with layer normalization however, causes the...
I got this error, but i'm not able to find where the error come from. ``` File "lstm_test.py", line 300, in test_script_stacked_bidir_rnn(5, 2, 3, 7, 4) File "lstm_test.py", line 275,...
Modify config files and setup_env to perform 1.13.0 pytorch release benchmark test
Previously, we would launch a different slurm job for measurement, e.g.: 1) resnet50 w/ inductor + graph breaks, 2 node 2) resnet50 w/ inductor + NO graph breaks, 2 node...
Stack from [ghstack](https://github.com/ezyang/ghstack): * __->__ #1243 Many of the models are fairly large, and 10 iterations is way too much (chrometrace take sa long time to load and freezes). 2...
TorchBench CI has detected a performance signal. Base PyTorch version: 1.14.0.dev20221009+cu116 Base PyTorch commit: 92ac84c98a19310885f3d818aba56b981940d615 Affected PyTorch version: 1.14.0.dev20221011+cu116 Affected PyTorch commit: ad2b04c39c41949d8869de743736bcaeec2dfa0d Affected Tests: - test_eval[mnasnet1_0-cpu-jit]: +7.04205% - test_eval[mobilenet_v2_quantized_qat-cpu-jit]:...