rl
rl copied to clipboard
Published
20 hours ago •
pytorch
pytorch
[Documentation] README rewrite and broken links
:link: Helpful Links
:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/2023
- :page_facing_up: Preview Python docs built from this PR
Note: Links to docs will display an error until the docs builds have been completed.
:heavy_exclamation_mark: 1 Active SEVs
There are 1 currently active SEVs. If your PR is affected, please view them below:
:x: 2 New Failures
As of commit 9b2a95d1507d959e8ccf75e3819294c8596f1264 with merge base 97471700524be9ba2ca44be6a38613f1211e8317 (
NEW FAILURES - The following jobs have failed:
-
Habitat Tests on Linux / tests (3.9, 11.6) / linux-job (gh)
RuntimeError: Command docker exec -t ff41713a4d8969ea0d9b8c48533349be179e847f5c32e8f5651398fa6edf1a59 /exec failed with exit code 139 -
Unit-tests on MacOS CPU / tests (3.11) / macos-job (gh)
test/test_loggers.py::TestTensorboard::test_log_scalar[steps1]
This comment was automatically generated by Dr. CI and updates every 15 minutes.
![pytorch-bot[bot] avatar](https://avatars.githubusercontent.com/in/40112?v=4 "Published by a pub.dev verified publisher"){kind=small}
$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests
Total Benchmarks: 91. Improved: $\large\color{#35bf28}11$. Worsened: $\large\color{#d91a1a}4$.
Expand to view detailed results
| Name | Max | Mean | Ops | Ops on Repo HEAD |
Change |
|---|---|---|---|---|---|
| test_single | 57.9777ms | 55.7489ms | 17.9376 Ops/s | 16.9048 Ops/s | $\textbf{\color{#35bf28}+6.11\%}$ |
| test_sync | 43.0824ms | 35.0418ms | 28.5374 Ops/s | 33.0567 Ops/s | $\textbf{\color{#d91a1a}-13.67\%}$ |
| test_async | 65.2070ms | 30.6451ms | 32.6316 Ops/s | 36.1725 Ops/s | $\textbf{\color{#d91a1a}-9.79\%}$ |
| test_simple | 0.3861s | 0.3391s | 2.9489 Ops/s | 2.9419 Ops/s | $\color{#35bf28}+0.24\%$ |
| test_transformed | 0.4764s | 0.4730s | 2.1139 Ops/s | 2.1376 Ops/s | $\color{#d91a1a}-1.11\%$ |
| test_serial | 1.2594s | 1.2071s | 0.8284 Ops/s | 0.8284 Ops/s | $+0.00\%$ |
| test_parallel | 1.1084s | 1.0539s | 0.9488 Ops/s | 0.9707 Ops/s | $\color{#d91a1a}-2.25\%$ |
| test_step_mdp_speed[True-True-True-True-True] | 0.1582ms | 21.7998μs | 45.8720 KOps/s | 46.6872 KOps/s | $\color{#d91a1a}-1.75\%$ |
| test_step_mdp_speed[True-True-True-True-False] | 0.1246ms | 13.2248μs | 75.6153 KOps/s | 76.8538 KOps/s | $\color{#d91a1a}-1.61\%$ |
| test_step_mdp_speed[True-True-True-False-True] | 0.2354ms | 14.8982μs | 67.1220 KOps/s | 79.6460 KOps/s | $\textbf{\color{#d91a1a}-15.72\%}$ |
| test_step_mdp_speed[True-True-True-False-False] | 42.7490μs | 7.9474μs | 125.8281 KOps/s | 125.1946 KOps/s | $\color{#35bf28}+0.51\%$ |
| test_step_mdp_speed[True-True-False-True-True] | 0.1004ms | 23.2023μs | 43.0993 KOps/s | 43.7381 KOps/s | $\color{#d91a1a}-1.46\%$ |
| test_step_mdp_speed[True-True-False-True-False] | 49.0510μs | 14.4618μs | 69.1475 KOps/s | 69.6890 KOps/s | $\color{#d91a1a}-0.78\%$ |
| test_step_mdp_speed[True-True-False-False-True] | 49.6330μs | 14.1154μs | 70.8446 KOps/s | 72.5073 KOps/s | $\color{#d91a1a}-2.29\%$ |
| test_step_mdp_speed[True-True-False-False-False] | 42.6090μs | 9.1640μs | 109.1228 KOps/s | 112.9555 KOps/s | $\color{#d91a1a}-3.39\%$ |
| test_step_mdp_speed[True-False-True-True-True] | 71.9140μs | 24.8103μs | 40.3059 KOps/s | 41.3110 KOps/s | $\color{#d91a1a}-2.43\%$ |
| test_step_mdp_speed[True-False-True-True-False] | 44.4340μs | 15.9415μs | 62.7294 KOps/s | 63.4823 KOps/s | $\color{#d91a1a}-1.19\%$ |
| test_step_mdp_speed[True-False-True-False-True] | 38.7420μs | 14.2988μs | 69.9360 KOps/s | 72.0696 KOps/s | $\color{#d91a1a}-2.96\%$ |
| test_step_mdp_speed[True-False-True-False-False] | 28.4130μs | 9.1000μs | 109.8898 KOps/s | 113.2135 KOps/s | $\color{#d91a1a}-2.94\%$ |
| test_step_mdp_speed[True-False-False-True-True] | 80.1500μs | 25.7951μs | 38.7671 KOps/s | 39.0909 KOps/s | $\color{#d91a1a}-0.83\%$ |
| test_step_mdp_speed[True-False-False-True-False] | 58.3800μs | 17.0691μs | 58.5854 KOps/s | 59.7416 KOps/s | $\color{#d91a1a}-1.94\%$ |
| test_step_mdp_speed[True-False-False-False-True] | 44.8240μs | 15.5162μs | 64.4486 KOps/s | 66.2369 KOps/s | $\color{#d91a1a}-2.70\%$ |
| test_step_mdp_speed[True-False-False-False-False] | 66.8360μs | 10.4320μs | 95.8586 KOps/s | 98.9069 KOps/s | $\color{#d91a1a}-3.08\%$ |
| test_step_mdp_speed[False-True-True-True-True] | 83.6470μs | 24.4339μs | 40.9267 KOps/s | 40.8860 KOps/s | $\color{#35bf28}+0.10\%$ |
| test_step_mdp_speed[False-True-True-True-False] | 71.6340μs | 16.0274μs | 62.3933 KOps/s | 63.3277 KOps/s | $\color{#d91a1a}-1.48\%$ |
| test_step_mdp_speed[False-True-True-False-True] | 48.6410μs | 16.4515μs | 60.7849 KOps/s | 61.6109 KOps/s | $\color{#d91a1a}-1.34\%$ |
| test_step_mdp_speed[False-True-True-False-False] | 63.4890μs | 10.3946μs | 96.2038 KOps/s | 98.1792 KOps/s | $\color{#d91a1a}-2.01\%$ |
| test_step_mdp_speed[False-True-False-True-True] | 41.4680μs | 26.1739μs | 38.2060 KOps/s | 38.3801 KOps/s | $\color{#d91a1a}-0.45\%$ |
| test_step_mdp_speed[False-True-False-True-False] | 54.1410μs | 17.0390μs | 58.6890 KOps/s | 58.8994 KOps/s | $\color{#d91a1a}-0.36\%$ |
| test_step_mdp_speed[False-True-False-False-True] | 57.2270μs | 17.7309μs | 56.3986 KOps/s | 57.5970 KOps/s | $\color{#d91a1a}-2.08\%$ |
| test_step_mdp_speed[False-True-False-False-False] | 43.2600μs | 11.5400μs | 86.6554 KOps/s | 87.9603 KOps/s | $\color{#d91a1a}-1.48\%$ |
| test_step_mdp_speed[False-False-True-True-True] | 76.6670μs | 26.8314μs | 37.2697 KOps/s | 37.4172 KOps/s | $\color{#d91a1a}-0.39\%$ |
| test_step_mdp_speed[False-False-True-True-False] | 43.7210μs | 18.4310μs | 54.2565 KOps/s | 54.7316 KOps/s | $\color{#d91a1a}-0.87\%$ |
| test_step_mdp_speed[False-False-True-False-True] | 74.7500μs | 17.6543μs | 56.6436 KOps/s | 57.2340 KOps/s | $\color{#d91a1a}-1.03\%$ |
| test_step_mdp_speed[False-False-True-False-False] | 70.1710μs | 11.5410μs | 86.6473 KOps/s | 88.1326 KOps/s | $\color{#d91a1a}-1.69\%$ |
| test_step_mdp_speed[False-False-False-True-True] | 71.2940μs | 27.9493μs | 35.7791 KOps/s | 36.3377 KOps/s | $\color{#d91a1a}-1.54\%$ |
| test_step_mdp_speed[False-False-False-True-False] | 74.1980μs | 19.3720μs | 51.6210 KOps/s | 51.8960 KOps/s | $\color{#d91a1a}-0.53\%$ |
| test_step_mdp_speed[False-False-False-False-True] | 42.3990μs | 18.7772μs | 53.2562 KOps/s | 55.0056 KOps/s | $\color{#d91a1a}-3.18\%$ |
| test_step_mdp_speed[False-False-False-False-False] | 59.0910μs | 12.6362μs | 79.1378 KOps/s | 81.0931 KOps/s | $\color{#d91a1a}-2.41\%$ |
| test_values[generalized_advantage_estimate-True-True] | 10.6700ms | 9.4741ms | 105.5511 Ops/s | 107.9727 Ops/s | $\color{#d91a1a}-2.24\%$ |
| test_values[vec_generalized_advantage_estimate-True-True] | 37.4906ms | 33.4143ms | 29.9273 Ops/s | 28.3934 Ops/s | $\textbf{\color{#35bf28}+5.40\%}$ |
| test_values[td0_return_estimate-False-False] | 0.2364ms | 0.1662ms | 6.0162 KOps/s | 5.8029 KOps/s | $\color{#35bf28}+3.68\%$ |
| test_values[td1_return_estimate-False-False] | 26.1372ms | 23.5929ms | 42.3857 Ops/s | 42.6675 Ops/s | $\color{#d91a1a}-0.66\%$ |
| test_values[vec_td1_return_estimate-False-False] | 36.6224ms | 33.6819ms | 29.6895 Ops/s | 28.3708 Ops/s | $\color{#35bf28}+4.65\%$ |
| test_values[td_lambda_return_estimate-True-False] | 36.6648ms | 33.7444ms | 29.6346 Ops/s | 29.2075 Ops/s | $\color{#35bf28}+1.46\%$ |
| test_values[vec_td_lambda_return_estimate-True-False] | 35.7078ms | 33.5175ms | 29.8351 Ops/s | 27.9981 Ops/s | $\textbf{\color{#35bf28}+6.56\%}$ |
| test_gae_speed[generalized_advantage_estimate-False-1-512] | 10.1210ms | 8.1693ms | 122.4102 Ops/s | 123.1978 Ops/s | $\color{#d91a1a}-0.64\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 2.3868ms | 1.9286ms | 518.5051 Ops/s | 494.6583 Ops/s | $\color{#35bf28}+4.82\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.5492ms | 0.3518ms | 2.8424 KOps/s | 2.7951 KOps/s | $\color{#35bf28}+1.69\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 50.3356ms | 45.5210ms | 21.9679 Ops/s | 21.5715 Ops/s | $\color{#35bf28}+1.84\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 3.1739ms | 3.0119ms | 332.0113 Ops/s | 329.4090 Ops/s | $\color{#35bf28}+0.79\%$ |
| test_dqn_speed | 1.6086ms | 1.3769ms | 726.2726 Ops/s | 717.4913 Ops/s | $\color{#35bf28}+1.22\%$ |
| test_ddpg_speed | 3.5536ms | 2.7103ms | 368.9659 Ops/s | 364.7031 Ops/s | $\color{#35bf28}+1.17\%$ |
| test_sac_speed | 12.1065ms | 8.3324ms | 120.0140 Ops/s | 116.2922 Ops/s | $\color{#35bf28}+3.20\%$ |
| test_redq_speed | 14.6140ms | 13.0151ms | 76.8339 Ops/s | 75.3225 Ops/s | $\color{#35bf28}+2.01\%$ |
| test_redq_deprec_speed | 14.8164ms | 13.2503ms | 75.4700 Ops/s | 71.7018 Ops/s | $\textbf{\color{#35bf28}+5.26\%}$ |
| test_td3_speed | 9.8471ms | 8.2522ms | 121.1800 Ops/s | 118.2978 Ops/s | $\color{#35bf28}+2.44\%$ |
| test_cql_speed | 37.0856ms | 35.9579ms | 27.8103 Ops/s | 27.4257 Ops/s | $\color{#35bf28}+1.40\%$ |
| test_a2c_speed | 8.5714ms | 7.3189ms | 136.6326 Ops/s | 131.8979 Ops/s | $\color{#35bf28}+3.59\%$ |
| test_ppo_speed | 9.5747ms | 7.6445ms | 130.8129 Ops/s | 124.9657 Ops/s | $\color{#35bf28}+4.68\%$ |
| test_reinforce_speed | 7.3620ms | 6.5434ms | 152.8266 Ops/s | 149.7160 Ops/s | $\color{#35bf28}+2.08\%$ |
| test_iql_speed | 0.1038s | 34.7224ms | 28.7999 Ops/s | 30.2935 Ops/s | $\color{#d91a1a}-4.93\%$ |
| test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 2.3191ms | 2.1462ms | 465.9502 Ops/s | 437.3070 Ops/s | $\textbf{\color{#35bf28}+6.55\%}$ |
| test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.6901ms | 0.4982ms | 2.0072 KOps/s | 1.8386 KOps/s | $\textbf{\color{#35bf28}+9.17\%}$ |
| test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 3.4910ms | 0.4723ms | 2.1175 KOps/s | 2.1414 KOps/s | $\color{#d91a1a}-1.11\%$ |
| test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 3.1416ms | 2.1590ms | 463.1683 Ops/s | 467.0470 Ops/s | $\color{#d91a1a}-0.83\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.8588ms | 0.4862ms | 2.0567 KOps/s | 2.0506 KOps/s | $\color{#35bf28}+0.29\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6243ms | 0.4645ms | 2.1530 KOps/s | 2.1600 KOps/s | $\color{#d91a1a}-0.33\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 2.0125ms | 1.2947ms | 772.3744 Ops/s | 773.2220 Ops/s | $\color{#d91a1a}-0.11\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.6541ms | 1.2250ms | 816.3014 Ops/s | 815.7854 Ops/s | $\color{#35bf28}+0.06\%$ |
| test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 3.4361ms | 2.2651ms | 441.4799 Ops/s | 446.5402 Ops/s | $\color{#d91a1a}-1.13\%$ |
| test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.7113ms | 0.6104ms | 1.6381 KOps/s | 1.6425 KOps/s | $\color{#d91a1a}-0.26\%$ |
| test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 3.7989ms | 0.5859ms | 1.7069 KOps/s | 1.7161 KOps/s | $\color{#d91a1a}-0.53\%$ |
| test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 2.3584ms | 2.1495ms | 465.2330 Ops/s | 448.0657 Ops/s | $\color{#35bf28}+3.83\%$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.6522ms | 0.4999ms | 2.0002 KOps/s | 1.9767 KOps/s | $\color{#35bf28}+1.19\%$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 3.7577ms | 0.4769ms | 2.0967 KOps/s | 2.0351 KOps/s | $\color{#35bf28}+3.02\%$ |
| test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 2.5972ms | 2.1520ms | 464.6879 Ops/s | 427.2003 Ops/s | $\textbf{\color{#35bf28}+8.78\%}$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 0.5886ms | 0.4899ms | 2.0411 KOps/s | 1.9925 KOps/s | $\color{#35bf28}+2.44\%$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.6151ms | 0.4649ms | 2.1508 KOps/s | 2.1093 KOps/s | $\color{#35bf28}+1.97\%$ |
| test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 2.7381ms | 2.2625ms | 441.9794 Ops/s | 409.8961 Ops/s | $\textbf{\color{#35bf28}+7.83\%}$ |
| test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 1.0782ms | 0.6120ms | 1.6339 KOps/s | 1.6045 KOps/s | $\color{#35bf28}+1.83\%$ |
| test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 0.7765ms | 0.5848ms | 1.7100 KOps/s | 1.6900 KOps/s | $\color{#35bf28}+1.18\%$ |
| test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 90.7539ms | 7.0077ms | 142.7010 Ops/s | 133.7667 Ops/s | $\textbf{\color{#35bf28}+6.68\%}$ |
| test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 14.8272ms | 12.0544ms | 82.9576 Ops/s | 82.7283 Ops/s | $\color{#35bf28}+0.28\%$ |
| test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 1.7692ms | 1.0471ms | 955.0167 Ops/s | 952.5637 Ops/s | $\color{#35bf28}+0.26\%$ |
| test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 86.3987ms | 5.3328ms | 187.5173 Ops/s | 144.3005 Ops/s | $\textbf{\color{#35bf28}+29.95\%}$ |
| test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 14.0794ms | 11.9814ms | 83.4624 Ops/s | 83.9063 Ops/s | $\color{#d91a1a}-0.53\%$ |
| test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 1.4918ms | 1.0425ms | 959.2401 Ops/s | 960.1312 Ops/s | $\color{#d91a1a}-0.09\%$ |
| test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 85.8220ms | 7.2424ms | 138.0761 Ops/s | 179.2067 Ops/s | $\textbf{\color{#d91a1a}-22.95\%}$ |
| test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 14.5428ms | 12.3523ms | 80.9565 Ops/s | 72.1692 Ops/s | $\textbf{\color{#35bf28}+12.18\%}$ |
| test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 2.0565ms | 1.3572ms | 736.8206 Ops/s | 728.0011 Ops/s | $\color{#35bf28}+1.21\%$ |
![github-actions[bot] avatar](https://avatars.githubusercontent.com/in/15368?v=4 "Published by a pub.dev verified publisher"){kind=small}
$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests
Total Benchmarks: 94. Improved: $\large\color{#35bf28}8$. Worsened: $\large\color{#d91a1a}3$.
Expand to view detailed results
| Name | Max | Mean | Ops | Ops on Repo HEAD |
Change |
|---|---|---|---|---|---|
| test_single | 0.1012s | 0.1009s | 9.9099 Ops/s | 9.2138 Ops/s | $\textbf{\color{#35bf28}+7.55\%}$ |
| test_sync | 91.4691ms | 89.1076ms | 11.2224 Ops/s | 11.3274 Ops/s | $\color{#d91a1a}-0.93\%$ |
| test_async | 0.1756s | 87.5507ms | 11.4220 Ops/s | 11.2979 Ops/s | $\color{#35bf28}+1.10\%$ |
| test_single_pixels | 0.1113s | 0.1109s | 9.0199 Ops/s | 8.8646 Ops/s | $\color{#35bf28}+1.75\%$ |
| test_sync_pixels | 68.9759ms | 66.8994ms | 14.9478 Ops/s | 14.6762 Ops/s | $\color{#35bf28}+1.85\%$ |
| test_async_pixels | 0.1241s | 63.6019ms | 15.7228 Ops/s | 17.7370 Ops/s | $\textbf{\color{#d91a1a}-11.36\%}$ |
| test_simple | 0.6735s | 0.6638s | 1.5065 Ops/s | 1.4501 Ops/s | $\color{#35bf28}+3.89\%$ |
| test_transformed | 0.8746s | 0.8690s | 1.1507 Ops/s | 1.1234 Ops/s | $\color{#35bf28}+2.43\%$ |
| test_serial | 2.1341s | 2.0780s | 0.4812 Ops/s | 0.4663 Ops/s | $\color{#35bf28}+3.20\%$ |
| test_parallel | 1.8624s | 1.8119s | 0.5519 Ops/s | 0.5516 Ops/s | $\color{#35bf28}+0.06\%$ |
| test_step_mdp_speed[True-True-True-True-True] | 87.9540μs | 32.9484μs | 30.3505 KOps/s | 31.0158 KOps/s | $\color{#d91a1a}-2.15\%$ |
| test_step_mdp_speed[True-True-True-True-False] | 45.5920μs | 19.2652μs | 51.9070 KOps/s | 51.7698 KOps/s | $\color{#35bf28}+0.27\%$ |
| test_step_mdp_speed[True-True-True-False-True] | 42.6920μs | 18.3851μs | 54.3919 KOps/s | 55.1222 KOps/s | $\color{#d91a1a}-1.32\%$ |
| test_step_mdp_speed[True-True-True-False-False] | 35.1020μs | 10.9459μs | 91.3582 KOps/s | 91.3320 KOps/s | $\color{#35bf28}+0.03\%$ |
| test_step_mdp_speed[True-True-False-True-True] | 62.2830μs | 34.6906μs | 28.8262 KOps/s | 29.6005 KOps/s | $\color{#d91a1a}-2.62\%$ |
| test_step_mdp_speed[True-True-False-True-False] | 39.9410μs | 20.8999μs | 47.8470 KOps/s | 46.9523 KOps/s | $\color{#35bf28}+1.91\%$ |
| test_step_mdp_speed[True-True-False-False-True] | 56.1230μs | 20.1097μs | 49.7271 KOps/s | 49.4366 KOps/s | $\color{#35bf28}+0.59\%$ |
| test_step_mdp_speed[True-True-False-False-False] | 31.0820μs | 12.8292μs | 77.9473 KOps/s | 76.8195 KOps/s | $\color{#35bf28}+1.47\%$ |
| test_step_mdp_speed[True-False-True-True-True] | 66.8830μs | 35.9823μs | 27.7915 KOps/s | 27.1879 KOps/s | $\color{#35bf28}+2.22\%$ |
| test_step_mdp_speed[True-False-True-True-False] | 54.1830μs | 22.7603μs | 43.9362 KOps/s | 42.5715 KOps/s | $\color{#35bf28}+3.21\%$ |
| test_step_mdp_speed[True-False-True-False-True] | 55.2820μs | 19.9520μs | 50.1202 KOps/s | 49.5770 KOps/s | $\color{#35bf28}+1.10\%$ |
| test_step_mdp_speed[True-False-True-False-False] | 30.9420μs | 12.7745μs | 78.2809 KOps/s | 77.7157 KOps/s | $\color{#35bf28}+0.73\%$ |
| test_step_mdp_speed[True-False-False-True-True] | 56.4720μs | 37.0774μs | 26.9706 KOps/s | 26.4433 KOps/s | $\color{#35bf28}+1.99\%$ |
| test_step_mdp_speed[True-False-False-True-False] | 43.7620μs | 24.1948μs | 41.3311 KOps/s | 39.9046 KOps/s | $\color{#35bf28}+3.57\%$ |
| test_step_mdp_speed[True-False-False-False-True] | 41.6420μs | 21.4888μs | 46.5358 KOps/s | 45.5966 KOps/s | $\color{#35bf28}+2.06\%$ |
| test_step_mdp_speed[True-False-False-False-False] | 47.3620μs | 14.4388μs | 69.2579 KOps/s | 67.5291 KOps/s | $\color{#35bf28}+2.56\%$ |
| test_step_mdp_speed[False-True-True-True-True] | 58.6320μs | 35.5675μs | 28.1155 KOps/s | 27.2872 KOps/s | $\color{#35bf28}+3.04\%$ |
| test_step_mdp_speed[False-True-True-True-False] | 45.4720μs | 22.5640μs | 44.3183 KOps/s | 43.0926 KOps/s | $\color{#35bf28}+2.84\%$ |
| test_step_mdp_speed[False-True-True-False-True] | 42.4720μs | 23.6731μs | 42.2420 KOps/s | 41.4781 KOps/s | $\color{#35bf28}+1.84\%$ |
| test_step_mdp_speed[False-True-True-False-False] | 32.5510μs | 14.4012μs | 69.4384 KOps/s | 67.3858 KOps/s | $\color{#35bf28}+3.05\%$ |
| test_step_mdp_speed[False-True-False-True-True] | 67.9130μs | 37.8800μs | 26.3992 KOps/s | 25.9951 KOps/s | $\color{#35bf28}+1.55\%$ |
| test_step_mdp_speed[False-True-False-True-False] | 53.3520μs | 24.7113μs | 40.4673 KOps/s | 39.5649 KOps/s | $\color{#35bf28}+2.28\%$ |
| test_step_mdp_speed[False-True-False-False-True] | 62.7820μs | 25.5261μs | 39.1755 KOps/s | 38.7498 KOps/s | $\color{#35bf28}+1.10\%$ |
| test_step_mdp_speed[False-True-False-False-False] | 35.8010μs | 16.1214μs | 62.0295 KOps/s | 59.5424 KOps/s | $\color{#35bf28}+4.18\%$ |
| test_step_mdp_speed[False-False-True-True-True] | 62.0330μs | 39.1537μs | 25.5404 KOps/s | 24.9841 KOps/s | $\color{#35bf28}+2.23\%$ |
| test_step_mdp_speed[False-False-True-True-False] | 55.7330μs | 26.1020μs | 38.3113 KOps/s | 36.7259 KOps/s | $\color{#35bf28}+4.32\%$ |
| test_step_mdp_speed[False-False-True-False-True] | 52.1920μs | 25.3336μs | 39.4732 KOps/s | 39.3613 KOps/s | $\color{#35bf28}+0.28\%$ |
| test_step_mdp_speed[False-False-True-False-False] | 34.6320μs | 16.0687μs | 62.2329 KOps/s | 60.1417 KOps/s | $\color{#35bf28}+3.48\%$ |
| test_step_mdp_speed[False-False-False-True-True] | 78.0430μs | 40.0598μs | 24.9627 KOps/s | 23.9904 KOps/s | $\color{#35bf28}+4.05\%$ |
| test_step_mdp_speed[False-False-False-True-False] | 51.6420μs | 27.8862μs | 35.8601 KOps/s | 34.0371 KOps/s | $\textbf{\color{#35bf28}+5.36\%}$ |
| test_step_mdp_speed[False-False-False-False-True] | 60.1430μs | 26.7447μs | 37.3906 KOps/s | 36.6674 KOps/s | $\color{#35bf28}+1.97\%$ |
| test_step_mdp_speed[False-False-False-False-False] | 38.0610μs | 17.8931μs | 55.8874 KOps/s | 53.8604 KOps/s | $\color{#35bf28}+3.76\%$ |
| test_values[generalized_advantage_estimate-True-True] | 25.0058ms | 24.7101ms | 40.4692 Ops/s | 39.6213 Ops/s | $\color{#35bf28}+2.14\%$ |
| test_values[vec_generalized_advantage_estimate-True-True] | 82.4572ms | 3.2081ms | 311.7097 Ops/s | 310.3259 Ops/s | $\color{#35bf28}+0.45\%$ |
| test_values[td0_return_estimate-False-False] | 93.3940μs | 63.9633μs | 15.6340 KOps/s | 15.4822 KOps/s | $\color{#35bf28}+0.98\%$ |
| test_values[td1_return_estimate-False-False] | 53.5075ms | 52.8251ms | 18.9304 Ops/s | 18.9085 Ops/s | $\color{#35bf28}+0.12\%$ |
| test_values[vec_td1_return_estimate-False-False] | 2.1381ms | 1.7631ms | 567.1700 Ops/s | 565.5485 Ops/s | $\color{#35bf28}+0.29\%$ |
| test_values[td_lambda_return_estimate-True-False] | 84.8528ms | 84.0894ms | 11.8921 Ops/s | 11.8444 Ops/s | $\color{#35bf28}+0.40\%$ |
| test_values[vec_td_lambda_return_estimate-True-False] | 2.1099ms | 1.7571ms | 569.1316 Ops/s | 567.6448 Ops/s | $\color{#35bf28}+0.26\%$ |
| test_gae_speed[generalized_advantage_estimate-False-1-512] | 24.0273ms | 23.3788ms | 42.7738 Ops/s | 43.1427 Ops/s | $\color{#d91a1a}-0.86\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-True-1-512] | 0.8947ms | 0.6946ms | 1.4396 KOps/s | 1.4243 KOps/s | $\color{#35bf28}+1.07\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-False-1-512] | 0.7159ms | 0.6435ms | 1.5539 KOps/s | 1.5341 KOps/s | $\color{#35bf28}+1.29\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-True-32-512] | 1.5133ms | 1.4473ms | 690.9555 Ops/s | 688.3611 Ops/s | $\color{#35bf28}+0.38\%$ |
| test_gae_speed[vec_generalized_advantage_estimate-False-32-512] | 0.9456ms | 0.6661ms | 1.5013 KOps/s | 1.4840 KOps/s | $\color{#35bf28}+1.17\%$ |
| test_dqn_speed | 8.7704ms | 1.4278ms | 700.3997 Ops/s | 670.6640 Ops/s | $\color{#35bf28}+4.43\%$ |
| test_ddpg_speed | 3.1917ms | 2.6885ms | 371.9482 Ops/s | 366.7211 Ops/s | $\color{#35bf28}+1.43\%$ |
| test_sac_speed | 8.6238ms | 8.0435ms | 124.3238 Ops/s | 124.4298 Ops/s | $\color{#d91a1a}-0.09\%$ |
| test_redq_speed | 11.6156ms | 10.2698ms | 97.3727 Ops/s | 97.6790 Ops/s | $\color{#d91a1a}-0.31\%$ |
| test_redq_deprec_speed | 11.7088ms | 10.8190ms | 92.4304 Ops/s | 91.4338 Ops/s | $\color{#35bf28}+1.09\%$ |
| test_td3_speed | 8.0754ms | 7.9243ms | 126.1947 Ops/s | 124.6049 Ops/s | $\color{#35bf28}+1.28\%$ |
| test_cql_speed | 26.1112ms | 25.1103ms | 39.8243 Ops/s | 39.7569 Ops/s | $\color{#35bf28}+0.17\%$ |
| test_a2c_speed | 5.6457ms | 5.4806ms | 182.4613 Ops/s | 183.5900 Ops/s | $\color{#d91a1a}-0.61\%$ |
| test_ppo_speed | 5.9871ms | 5.7942ms | 172.5855 Ops/s | 171.8455 Ops/s | $\color{#35bf28}+0.43\%$ |
| test_reinforce_speed | 4.7242ms | 4.4704ms | 223.6919 Ops/s | 222.2220 Ops/s | $\color{#35bf28}+0.66\%$ |
| test_iql_speed | 20.4906ms | 19.4658ms | 51.3721 Ops/s | 51.6621 Ops/s | $\color{#d91a1a}-0.56\%$ |
| test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 3.0761ms | 2.8660ms | 348.9161 Ops/s | 342.2744 Ops/s | $\color{#35bf28}+1.94\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 1.0971ms | 0.5370ms | 1.8621 KOps/s | 1.8316 KOps/s | $\color{#35bf28}+1.67\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.6996ms | 0.5161ms | 1.9378 KOps/s | 1.9157 KOps/s | $\color{#35bf28}+1.15\%$ |
| test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 3.1391ms | 2.8401ms | 352.1035 Ops/s | 339.8522 Ops/s | $\color{#35bf28}+3.60\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.2372ms | 0.5271ms | 1.8972 KOps/s | 1.8719 KOps/s | $\color{#35bf28}+1.35\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7263ms | 0.5081ms | 1.9682 KOps/s | 1.9240 KOps/s | $\color{#35bf28}+2.29\%$ |
| test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] | 0.1171s | 1.7519ms | 570.7941 Ops/s | 654.6545 Ops/s | $\textbf{\color{#d91a1a}-12.81\%}$ |
| test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] | 1.5612ms | 1.4212ms | 703.6542 Ops/s | 685.7876 Ops/s | $\color{#35bf28}+2.61\%$ |
| test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 3.1872ms | 2.9766ms | 335.9507 Ops/s | 326.9156 Ops/s | $\color{#35bf28}+2.76\%$ |
| test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.7906ms | 0.6619ms | 1.5108 KOps/s | 1.2860 KOps/s | $\textbf{\color{#35bf28}+17.48\%}$ |
| test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 4.4077ms | 0.6448ms | 1.5509 KOps/s | 1.5413 KOps/s | $\color{#35bf28}+0.62\%$ |
| test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] | 3.0067ms | 2.8526ms | 350.5570 Ops/s | 342.7103 Ops/s | $\color{#35bf28}+2.29\%$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] | 0.6508ms | 0.5367ms | 1.8632 KOps/s | 1.8375 KOps/s | $\color{#35bf28}+1.40\%$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] | 0.7158ms | 0.5190ms | 1.9266 KOps/s | 1.9263 KOps/s | $\color{#35bf28}+0.02\%$ |
| test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] | 3.0653ms | 2.8793ms | 347.3049 Ops/s | 341.3686 Ops/s | $\color{#35bf28}+1.74\%$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] | 1.3107ms | 0.5326ms | 1.8777 KOps/s | 1.8574 KOps/s | $\color{#35bf28}+1.09\%$ |
| test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] | 0.7906ms | 0.5126ms | 1.9508 KOps/s | 1.9181 KOps/s | $\color{#35bf28}+1.71\%$ |
| test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] | 3.1515ms | 2.9873ms | 334.7457 Ops/s | 327.5978 Ops/s | $\color{#35bf28}+2.18\%$ |
| test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] | 0.8474ms | 0.6752ms | 1.4811 KOps/s | 1.4813 KOps/s | $\color{#d91a1a}-0.01\%$ |
| test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] | 4.4708ms | 0.6459ms | 1.5481 KOps/s | 1.5377 KOps/s | $\color{#35bf28}+0.68\%$ |
| test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] | 0.1172s | 7.0125ms | 142.6022 Ops/s | 109.5148 Ops/s | $\textbf{\color{#35bf28}+30.21\%}$ |
| test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] | 17.7132ms | 14.2709ms | 70.0729 Ops/s | 67.7201 Ops/s | $\color{#35bf28}+3.47\%$ |
| test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] | 2.1042ms | 1.0604ms | 943.0021 Ops/s | 850.6732 Ops/s | $\textbf{\color{#35bf28}+10.85\%}$ |
| test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] | 0.1023s | 8.7140ms | 114.7582 Ops/s | 148.2461 Ops/s | $\textbf{\color{#d91a1a}-22.59\%}$ |
| test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] | 16.6287ms | 14.2750ms | 70.0527 Ops/s | 67.8195 Ops/s | $\color{#35bf28}+3.29\%$ |
| test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] | 1.1031ms | 1.0472ms | 954.9618 Ops/s | 781.3069 Ops/s | $\textbf{\color{#35bf28}+22.23\%}$ |
| test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] | 0.1031s | 7.0988ms | 140.8696 Ops/s | 110.4590 Ops/s | $\textbf{\color{#35bf28}+27.53\%}$ |
| test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] | 16.9708ms | 14.5407ms | 68.7725 Ops/s | 65.8579 Ops/s | $\color{#35bf28}+4.43\%$ |
| test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] | 1.5095ms | 1.4051ms | 711.6999 Ops/s | 674.6450 Ops/s | $\textbf{\color{#35bf28}+5.49\%}$ |