benchmark
benchmark copied to clipboard
pytorch
TorchBench is a collection of open source benchmarks used to evaluate PyTorch performance.
Since we have no plan on building CI on distributed cluster, we want to be able to create a distributed wrapper to the models and submit MAST jobs internally.
Start hash: 4c73f163cd9c313b0ac2ea6ef71fe06d62bb4fba End hash: 64141411e0de61b61857e216ae7a8766f4f5969b Userbenchmark: test_bench Userbenchmark options: -d cpu -m detectron2_fasterrcnn_r_101_c4 -t train Bisection: https://github.com/pytorch/benchmark/actions/runs/11116416639
TorchBench CI has detected a performance signal. Base PyTorch version: 2.4.0.dev20240606+cu121 Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1 Affected PyTorch version: 2.6.0.dev20240928+cu124 Affected PyTorch commit: f42e88fea5915012ddb4cd9530f367524bf57019 Affected Tests: - test_train[Super_SloMo-cuda-eager]: +14.62201% - test_eval[Super_SloMo-cuda-eager]:...
TorchBench CI has detected a performance signal. Base PyTorch version: 2.4.0.dev20240606+cu121 Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1 Affected PyTorch version: 2.6.0.dev20240925+cu124 Affected PyTorch commit: 780f4debdbb51347da5b416416392e5849cbfec5 Affected Tests: - test_train[Super_SloMo-cuda-eager]: +14.62530% - test_eval[Super_SloMo-cuda-eager]:...
TorchBench CI has detected a performance signal. Base PyTorch version: 2.4.0.dev20240606+cu121 Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1 Affected PyTorch version: 2.6.0.dev20240925+cu124 Affected PyTorch commit: 780f4debdbb51347da5b416416392e5849cbfec5 Affected Tests: - test_train[Super_SloMo-cuda-eager]: +14.62361% - test_eval[Super_SloMo-cuda-eager]:...
TorchBench CI has detected a performance signal. Base PyTorch version: 2.4.0.dev20240606+cu121 Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1 Affected PyTorch version: 2.6.0.dev20240920+cu124 Affected PyTorch commit: fe0e9fb385d6e75a01c9feaa459252db09b71839 Affected Tests: - test_train[Super_SloMo-cuda-eager]: +14.61819% - test_eval[Super_SloMo-cuda-eager]:...
TorchBench CI has detected a performance signal. Base PyTorch version: 2.4.0.dev20240606+cu121 Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1 Affected PyTorch version: 2.6.0.dev20240919+cu124 Affected PyTorch commit: e037bb326fdafca243bdb08023bbef93b29a4513 Affected Tests: - test_train[Super_SloMo-cuda-eager]: +14.62943% - test_eval[Super_SloMo-cuda-eager]:...
TorchBench CI has detected a performance signal. Base PyTorch version: 2.4.0.dev20240606+cu121 Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1 Affected PyTorch version: 2.6.0.dev20240918+cu124 Affected PyTorch commit: 48d18fbd4cf785e1f69a6555d97a39023a5d199e Affected Tests: - test_train[Super_SloMo-cuda-eager]: +14.61260% - test_eval[Super_SloMo-cuda-eager]:...
TorchBench CI has detected a performance signal. Base PyTorch version: 2.4.0.dev20240606+cu121 Base PyTorch commit: ffaea656b5d8ff6518669494cc8f664b94f8e8b1 Affected PyTorch version: 2.6.0.dev20240917+cu124 Affected PyTorch commit: 37a08b33bb86ad0fce3db6fc98f90c9e02d77cba Affected Tests: - test_train[Super_SloMo-cuda-eager]: +14.62766% - test_eval[Super_SloMo-cuda-eager]:...