Skip to content

[Test] Simplify num_threads test to check threads in env factory #3273

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
vmoens merged 2 commits into from
Dec 31, 2025
Merged

[Test] Simplify num_threads test to check threads in env factory #3273

vmoens merged 2 commits into from
Dec 31, 2025

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 31, 2025 •
edited
Loading

Stack from ghstack (oldest at bottom):

@vmoens
Update
75eb3d9 
[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 31, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3273

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

This was referenced Dec 31, 2025
Merged
Merged
Merged
Merged
Merged
Merged
Merged
Merged
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 31, 2025
@vmoens
Update
beab139 
[ghstack-poisoned]
This was referenced Dec 31, 2025
Merged
Merged
Merged
vmoens added a commit that referenced this pull request Dec 31, 2025
@vmoens
[Test] Simplify num_threads test to check threads in env factory
295cc20 
ghstack-source-id: 4070384
Pull-Request: #3273
@vmoens vmoens merged commit beab139 into gh/vmoens/173/base Dec 31, 2025
80 of 93 checks passed
@vmoens vmoens deleted the gh/vmoens/173/head branch December 31, 2025 09:17
@github-actions
Copy link

github-actions bot commented Dec 31, 2025

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}23$. Worsened: $\large\color{#d91a1a}6$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 82.0471μs 80.9510μs 12.3532 KOps/s 12.2274 KOps/s $\color{#35bf28}+1.03\%$
test_tensor_to_bytestream_speed[torch.save] 0.1409ms 0.1404ms 7.1246 KOps/s 7.0960 KOps/s $\color{#35bf28}+0.40\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1195s 0.1187s 8.4217 Ops/s 8.4014 Ops/s $\color{#35bf28}+0.24\%$
test_tensor_to_bytestream_speed[numpy] 2.7569μs 2.7436μs 364.4900 KOps/s 377.3215 KOps/s $\color{#d91a1a}-3.40\%$
test_tensor_to_bytestream_speed[safetensors] 42.4884μs 39.8136μs 25.1170 KOps/s 25.3241 KOps/s $\color{#d91a1a}-0.82\%$
test_simple 0.5716s 0.5591s 1.7884 Ops/s 1.7361 Ops/s $\color{#35bf28}+3.01\%$
test_transformed 1.1540s 1.1448s 0.8735 Ops/s 0.8695 Ops/s $\color{#35bf28}+0.46\%$
test_serial 1.7050s 1.6973s 0.5892 Ops/s 0.5865 Ops/s $\color{#35bf28}+0.46\%$
test_parallel 1.2418s 1.1866s 0.8427 Ops/s 0.8000 Ops/s $\textbf{\color{#35bf28}+5.34\%}$
test_step_mdp_speed[True-True-True-True-True] 0.2760ms 44.9913μs 22.2265 KOps/s 23.0737 KOps/s $\color{#d91a1a}-3.67\%$
test_step_mdp_speed[True-True-True-True-False] 89.7910μs 24.9301μs 40.1122 KOps/s 40.6770 KOps/s $\color{#d91a1a}-1.39\%$
test_step_mdp_speed[True-True-True-False-True] 61.0910μs 25.1674μs 39.7340 KOps/s 40.5400 KOps/s $\color{#d91a1a}-1.99\%$
test_step_mdp_speed[True-True-True-False-False] 42.6910μs 13.8985μs 71.9500 KOps/s 72.6165 KOps/s $\color{#d91a1a}-0.92\%$
test_step_mdp_speed[True-True-False-True-True] 94.6020μs 47.4459μs 21.0766 KOps/s 21.1885 KOps/s $\color{#d91a1a}-0.53\%$
test_step_mdp_speed[True-True-False-True-False] 61.8910μs 27.5205μs 36.3366 KOps/s 36.4268 KOps/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[True-True-False-False-True] 65.0820μs 28.1117μs 35.5723 KOps/s 35.8962 KOps/s $\color{#d91a1a}-0.90\%$
test_step_mdp_speed[True-True-False-False-False] 55.4810μs 16.5508μs 60.4202 KOps/s 60.9544 KOps/s $\color{#d91a1a}-0.88\%$
test_step_mdp_speed[True-False-True-True-True] 0.1328ms 50.0725μs 19.9711 KOps/s 19.8449 KOps/s $\color{#35bf28}+0.64\%$
test_step_mdp_speed[True-False-True-True-False] 0.1116ms 30.0908μs 33.2327 KOps/s 33.1959 KOps/s $\color{#35bf28}+0.11\%$
test_step_mdp_speed[True-False-True-False-True] 0.4488ms 27.5953μs 36.2381 KOps/s 35.9081 KOps/s $\color{#35bf28}+0.92\%$
test_step_mdp_speed[True-False-True-False-False] 47.3110μs 16.4592μs 60.7563 KOps/s 60.9785 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[True-False-False-True-True] 0.4839ms 53.2410μs 18.7825 KOps/s 18.9049 KOps/s $\color{#d91a1a}-0.65\%$
test_step_mdp_speed[True-False-False-True-False] 0.4583ms 33.0253μs 30.2798 KOps/s 30.4616 KOps/s $\color{#d91a1a}-0.60\%$
test_step_mdp_speed[True-False-False-False-True] 0.4475ms 30.5576μs 32.7251 KOps/s 32.4866 KOps/s $\color{#35bf28}+0.73\%$
test_step_mdp_speed[True-False-False-False-False] 53.0510μs 19.1673μs 52.1721 KOps/s 52.5853 KOps/s $\color{#d91a1a}-0.79\%$
test_step_mdp_speed[False-True-True-True-True] 88.1520μs 50.4833μs 19.8085 KOps/s 20.1182 KOps/s $\color{#d91a1a}-1.54\%$
test_step_mdp_speed[False-True-True-True-False] 0.4467ms 30.9082μs 32.3539 KOps/s 33.2252 KOps/s $\color{#d91a1a}-2.62\%$
test_step_mdp_speed[False-True-True-False-True] 2.3226ms 31.6765μs 31.5692 KOps/s 31.7960 KOps/s $\color{#d91a1a}-0.71\%$
test_step_mdp_speed[False-True-True-False-False] 53.1710μs 18.5857μs 53.8049 KOps/s 54.6478 KOps/s $\color{#d91a1a}-1.54\%$
test_step_mdp_speed[False-True-False-True-True] 0.4749ms 53.3963μs 18.7279 KOps/s 18.8680 KOps/s $\color{#d91a1a}-0.74\%$
test_step_mdp_speed[False-True-False-True-False] 0.4491ms 33.2130μs 30.1087 KOps/s 30.8189 KOps/s $\color{#d91a1a}-2.30\%$
test_step_mdp_speed[False-True-False-False-True] 81.7420μs 34.4332μs 29.0417 KOps/s 29.7623 KOps/s $\color{#d91a1a}-2.42\%$
test_step_mdp_speed[False-True-False-False-False] 0.4403ms 20.8422μs 47.9796 KOps/s 48.5647 KOps/s $\color{#d91a1a}-1.20\%$
test_step_mdp_speed[False-False-True-True-True] 0.4848ms 55.8124μs 17.9172 KOps/s 18.3382 KOps/s $\color{#d91a1a}-2.30\%$
test_step_mdp_speed[False-False-True-True-False] 0.4647ms 35.8155μs 27.9209 KOps/s 28.2215 KOps/s $\color{#d91a1a}-1.07\%$
test_step_mdp_speed[False-False-True-False-True] 71.9620μs 34.0949μs 29.3299 KOps/s 29.5925 KOps/s $\color{#d91a1a}-0.89\%$
test_step_mdp_speed[False-False-True-False-False] 0.4582ms 20.3855μs 49.0545 KOps/s 48.4075 KOps/s $\color{#35bf28}+1.34\%$
test_step_mdp_speed[False-False-False-True-True] 0.4754ms 56.8884μs 17.5783 KOps/s 17.4305 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[False-False-False-True-False] 0.4507ms 37.9686μs 26.3376 KOps/s 26.2580 KOps/s $\color{#35bf28}+0.30\%$
test_step_mdp_speed[False-False-False-False-True] 73.4920μs 36.2384μs 27.5951 KOps/s 27.9599 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[False-False-False-False-False] 58.7720μs 23.4837μs 42.5827 KOps/s 43.4084 KOps/s $\color{#d91a1a}-1.90\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8843s 0.7849s 1.2740 Ops/s 1.2843 Ops/s $\color{#d91a1a}-0.80\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7423s 0.6464s 1.5470 Ops/s 1.5560 Ops/s $\color{#d91a1a}-0.58\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7818s 1.7135s 0.5836 Ops/s 0.5866 Ops/s $\color{#d91a1a}-0.52\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5878s 1.4960s 0.6684 Ops/s 0.6738 Ops/s $\color{#d91a1a}-0.80\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 2.0771s 1.9828s 0.5043 Ops/s 0.5123 Ops/s $\color{#d91a1a}-1.55\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.8253s 1.7348s 0.5764 Ops/s 0.5783 Ops/s $\color{#d91a1a}-0.31\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.9815s 4.7738s 0.2095 Ops/s 0.2149 Ops/s $\color{#d91a1a}-2.52\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.6238s 4.5041s 0.2220 Ops/s 0.2176 Ops/s $\color{#35bf28}+2.05\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0590s 1.9709s 0.5074 Ops/s 0.4991 Ops/s $\color{#35bf28}+1.66\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7904s 1.7171s 0.5824 Ops/s 0.5890 Ops/s $\color{#d91a1a}-1.13\%$
test_values[generalized_advantage_estimate-True-True] 10.4611ms 10.3014ms 97.0745 Ops/s 97.0032 Ops/s $\color{#35bf28}+0.07\%$
test_values[vec_generalized_advantage_estimate-True-True] 14.6566ms 11.2507ms 88.8836 Ops/s 87.6453 Ops/s $\color{#35bf28}+1.41\%$
test_values[td0_return_estimate-False-False] 0.2124ms 0.1297ms 7.7073 KOps/s 7.8108 KOps/s $\color{#d91a1a}-1.32\%$
test_values[td1_return_estimate-False-False] 29.1944ms 28.0240ms 35.6837 Ops/s 36.1525 Ops/s $\color{#d91a1a}-1.30\%$
test_values[vec_td1_return_estimate-False-False] 12.3825ms 11.3651ms 87.9887 Ops/s 88.1352 Ops/s $\color{#d91a1a}-0.17\%$
test_values[td_lambda_return_estimate-True-False] 43.3750ms 41.8463ms 23.8970 Ops/s 24.3530 Ops/s $\color{#d91a1a}-1.87\%$
test_values[vec_td_lambda_return_estimate-True-False] 12.2420ms 11.4485ms 87.3479 Ops/s 88.8860 Ops/s $\color{#d91a1a}-1.73\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.4950ms 9.2165ms 108.5015 Ops/s 107.9536 Ops/s $\color{#35bf28}+0.51\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.9359ms 1.5190ms 658.3482 Ops/s 641.6085 Ops/s $\color{#35bf28}+2.61\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4928ms 0.4279ms 2.3372 KOps/s 2.3808 KOps/s $\color{#d91a1a}-1.84\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 30.3745ms 29.6511ms 33.7255 Ops/s 34.4974 Ops/s $\color{#d91a1a}-2.24\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.1434ms 1.8402ms 543.4064 Ops/s 549.9427 Ops/s $\color{#d91a1a}-1.19\%$
test_dqn_speed[False-None] 1.8631ms 1.4387ms 695.0702 Ops/s 714.2569 Ops/s $\color{#d91a1a}-2.69\%$
test_dqn_speed[False-backward] 2.0208ms 1.9364ms 516.4119 Ops/s 522.3267 Ops/s $\color{#d91a1a}-1.13\%$
test_dqn_speed[True-None] 0.8886ms 0.5283ms 1.8929 KOps/s 1.8613 KOps/s $\color{#35bf28}+1.70\%$
test_dqn_speed[True-backward] 1.0046ms 0.9718ms 1.0291 KOps/s 915.3024 Ops/s $\textbf{\color{#35bf28}+12.43\%}$
test_dqn_speed[reduce-overhead-None] 0.9235ms 0.5209ms 1.9198 KOps/s 1.8501 KOps/s $\color{#35bf28}+3.77\%$
test_dqn_speed[reduce-overhead-backward] 0.9891ms 0.9568ms 1.0451 KOps/s 1.0234 KOps/s $\color{#35bf28}+2.12\%$
test_ddpg_speed[False-None] 3.1894ms 2.8817ms 347.0129 Ops/s 350.2896 Ops/s $\color{#d91a1a}-0.94\%$
test_ddpg_speed[False-backward] 4.2073ms 4.0811ms 245.0323 Ops/s 246.2084 Ops/s $\color{#d91a1a}-0.48\%$
test_ddpg_speed[True-None] 1.5410ms 1.3723ms 728.7223 Ops/s 717.4288 Ops/s $\color{#35bf28}+1.57\%$
test_ddpg_speed[True-backward] 2.4062ms 2.3432ms 426.7654 Ops/s 425.7936 Ops/s $\color{#35bf28}+0.23\%$
test_ddpg_speed[reduce-overhead-None] 1.7699ms 1.3670ms 731.5374 Ops/s 722.6569 Ops/s $\color{#35bf28}+1.23\%$
test_ddpg_speed[reduce-overhead-backward] 2.3650ms 2.3166ms 431.6627 Ops/s 426.9836 Ops/s $\color{#35bf28}+1.10\%$
test_sac_speed[False-None] 8.4311ms 7.9804ms 125.3067 Ops/s 125.9135 Ops/s $\color{#d91a1a}-0.48\%$
test_sac_speed[False-backward] 12.0221ms 11.2136ms 89.1773 Ops/s 89.6646 Ops/s $\color{#d91a1a}-0.54\%$
test_sac_speed[True-None] 2.4733ms 2.1008ms 476.0007 Ops/s 472.5263 Ops/s $\color{#35bf28}+0.74\%$
test_sac_speed[True-backward] 4.2928ms 4.0077ms 249.5171 Ops/s 234.7767 Ops/s $\textbf{\color{#35bf28}+6.28\%}$
test_sac_speed[reduce-overhead-None] 2.2858ms 2.1045ms 475.1770 Ops/s 456.7690 Ops/s $\color{#35bf28}+4.03\%$
test_sac_speed[reduce-overhead-backward] 4.1009ms 3.9887ms 250.7101 Ops/s 219.3658 Ops/s $\textbf{\color{#35bf28}+14.29\%}$
test_redq_speed[False-None] 10.7847ms 10.3623ms 96.5039 Ops/s 96.1921 Ops/s $\color{#35bf28}+0.32\%$
test_redq_speed[False-backward] 18.1738ms 17.7508ms 56.3355 Ops/s 57.6941 Ops/s $\color{#d91a1a}-2.35\%$
test_redq_speed[True-None] 4.7898ms 4.3694ms 228.8646 Ops/s 213.6477 Ops/s $\textbf{\color{#35bf28}+7.12\%}$
test_redq_speed[True-backward] 9.9871ms 9.6706ms 103.4065 Ops/s 108.7433 Ops/s $\color{#d91a1a}-4.91\%$
test_redq_speed[reduce-overhead-None] 4.5414ms 4.3429ms 230.2590 Ops/s 234.8005 Ops/s $\color{#d91a1a}-1.93\%$
test_redq_speed[reduce-overhead-backward] 10.2981ms 9.8584ms 101.4368 Ops/s 104.3734 Ops/s $\color{#d91a1a}-2.81\%$
test_redq_deprec_speed[False-None] 11.6042ms 11.0580ms 90.4323 Ops/s 88.5776 Ops/s $\color{#35bf28}+2.09\%$
test_redq_deprec_speed[False-backward] 16.2207ms 15.9035ms 62.8792 Ops/s 62.5516 Ops/s $\color{#35bf28}+0.52\%$
test_redq_deprec_speed[True-None] 3.9823ms 3.5946ms 278.1943 Ops/s 262.0763 Ops/s $\textbf{\color{#35bf28}+6.15\%}$
test_redq_deprec_speed[True-backward] 7.8908ms 7.4781ms 133.7242 Ops/s 126.0863 Ops/s $\textbf{\color{#35bf28}+6.06\%}$
test_redq_deprec_speed[reduce-overhead-None] 3.8383ms 3.5188ms 284.1851 Ops/s 278.4634 Ops/s $\color{#35bf28}+2.05\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.6081ms 7.4638ms 133.9809 Ops/s 108.8126 Ops/s $\textbf{\color{#35bf28}+23.13\%}$
test_td3_speed[False-None] 8.1092ms 8.0517ms 124.1968 Ops/s 124.2474 Ops/s $\color{#d91a1a}-0.04\%$
test_td3_speed[False-backward] 11.3065ms 10.8889ms 91.8370 Ops/s 91.9540 Ops/s $\color{#d91a1a}-0.13\%$
test_td3_speed[True-None] 1.8481ms 1.8036ms 554.4498 Ops/s 548.7058 Ops/s $\color{#35bf28}+1.05\%$
test_td3_speed[True-backward] 3.9129ms 3.5847ms 278.9628 Ops/s 280.0487 Ops/s $\color{#d91a1a}-0.39\%$
test_td3_speed[reduce-overhead-None] 1.8390ms 1.7885ms 559.1130 Ops/s 553.9663 Ops/s $\color{#35bf28}+0.93\%$
test_td3_speed[reduce-overhead-backward] 3.8221ms 3.6852ms 271.3563 Ops/s 218.4156 Ops/s $\textbf{\color{#35bf28}+24.24\%}$
test_cql_speed[False-None] 28.6606ms 26.0229ms 38.4277 Ops/s 38.1407 Ops/s $\color{#35bf28}+0.75\%$
test_cql_speed[False-backward] 35.8455ms 34.9558ms 28.6076 Ops/s 28.2335 Ops/s $\color{#35bf28}+1.32\%$
test_cql_speed[True-None] 12.6676ms 12.2222ms 81.8181 Ops/s 78.7997 Ops/s $\color{#35bf28}+3.83\%$
test_cql_speed[True-backward] 18.6465ms 18.2293ms 54.8567 Ops/s 55.8603 Ops/s $\color{#d91a1a}-1.80\%$
test_cql_speed[reduce-overhead-None] 12.7126ms 12.3538ms 80.9467 Ops/s 75.1824 Ops/s $\textbf{\color{#35bf28}+7.67\%}$
test_cql_speed[reduce-overhead-backward] 18.5697ms 18.2632ms 54.7550 Ops/s 54.7025 Ops/s $\color{#35bf28}+0.10\%$
test_a2c_speed[False-None] 5.9434ms 5.4873ms 182.2382 Ops/s 181.2226 Ops/s $\color{#35bf28}+0.56\%$
test_a2c_speed[False-backward] 12.1892ms 11.8846ms 84.1423 Ops/s 83.6780 Ops/s $\color{#35bf28}+0.55\%$
test_a2c_speed[True-None] 3.8152ms 3.6853ms 271.3480 Ops/s 267.8788 Ops/s $\color{#35bf28}+1.30\%$
test_a2c_speed[True-backward] 8.8720ms 8.5515ms 116.9383 Ops/s 115.7480 Ops/s $\color{#35bf28}+1.03\%$
test_a2c_speed[reduce-overhead-None] 3.9763ms 3.7010ms 270.1943 Ops/s 272.8448 Ops/s $\color{#d91a1a}-0.97\%$
test_a2c_speed[reduce-overhead-backward] 8.8975ms 8.6074ms 116.1795 Ops/s 101.2474 Ops/s $\textbf{\color{#35bf28}+14.75\%}$
test_ppo_speed[False-None] 6.2176ms 5.9431ms 168.2610 Ops/s 170.8520 Ops/s $\color{#d91a1a}-1.52\%$
test_ppo_speed[False-backward] 12.7789ms 12.4515ms 80.3117 Ops/s 81.0466 Ops/s $\color{#d91a1a}-0.91\%$
test_ppo_speed[True-None] 4.0193ms 3.6043ms 277.4451 Ops/s 279.6882 Ops/s $\color{#d91a1a}-0.80\%$
test_ppo_speed[True-backward] 8.8237ms 8.3780ms 119.3598 Ops/s 118.8785 Ops/s $\color{#35bf28}+0.40\%$
test_ppo_speed[reduce-overhead-None] 3.8379ms 3.6005ms 277.7393 Ops/s 278.9986 Ops/s $\color{#d91a1a}-0.45\%$
test_ppo_speed[reduce-overhead-backward] 8.8703ms 8.5308ms 117.2224 Ops/s 111.0938 Ops/s $\textbf{\color{#35bf28}+5.52\%}$
test_reinforce_speed[False-None] 4.8100ms 4.5292ms 220.7898 Ops/s 218.1827 Ops/s $\color{#35bf28}+1.19\%$
test_reinforce_speed[False-backward] 7.5615ms 7.2839ms 137.2882 Ops/s 134.3755 Ops/s $\color{#35bf28}+2.17\%$
test_reinforce_speed[True-None] 3.2295ms 2.8563ms 350.1003 Ops/s 329.6102 Ops/s $\textbf{\color{#35bf28}+6.22\%}$
test_reinforce_speed[True-backward] 7.7815ms 7.6149ms 131.3213 Ops/s 131.7131 Ops/s $\color{#d91a1a}-0.30\%$
test_reinforce_speed[reduce-overhead-None] 3.0381ms 2.8255ms 353.9191 Ops/s 355.8013 Ops/s $\color{#d91a1a}-0.53\%$
test_reinforce_speed[reduce-overhead-backward] 8.1435ms 7.8849ms 126.8254 Ops/s 126.9197 Ops/s $\color{#d91a1a}-0.07\%$
test_iql_speed[False-None] 26.5827ms 20.2416ms 49.4033 Ops/s 48.8973 Ops/s $\color{#35bf28}+1.03\%$
test_iql_speed[False-backward] 31.1466ms 30.1355ms 33.1835 Ops/s 32.9275 Ops/s $\color{#35bf28}+0.78\%$
test_iql_speed[True-None] 9.0564ms 8.4795ms 117.9318 Ops/s 117.3775 Ops/s $\color{#35bf28}+0.47\%$
test_iql_speed[True-backward] 17.1761ms 16.5561ms 60.4006 Ops/s 60.9312 Ops/s $\color{#d91a1a}-0.87\%$
test_iql_speed[reduce-overhead-None] 8.9140ms 8.4797ms 117.9293 Ops/s 117.2353 Ops/s $\color{#35bf28}+0.59\%$
test_iql_speed[reduce-overhead-backward] 17.3524ms 16.9943ms 58.8432 Ops/s 57.4430 Ops/s $\color{#35bf28}+2.44\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 8.1311ms 6.1154ms 163.5206 Ops/s 163.9346 Ops/s $\color{#d91a1a}-0.25\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6369ms 0.3601ms 2.7772 KOps/s 2.8826 KOps/s $\color{#d91a1a}-3.66\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6350ms 0.3421ms 2.9234 KOps/s 3.1023 KOps/s $\textbf{\color{#d91a1a}-5.77\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1927ms 5.8189ms 171.8549 Ops/s 171.7995 Ops/s $\color{#35bf28}+0.03\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6343s 0.7639ms 1.3090 KOps/s 3.1539 KOps/s $\textbf{\color{#d91a1a}-58.50\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6855ms 0.2618ms 3.8199 KOps/s 3.5805 KOps/s $\textbf{\color{#35bf28}+6.68\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.6455ms 1.3717ms 729.0062 Ops/s 746.0161 Ops/s $\color{#d91a1a}-2.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5564ms 1.2903ms 775.0346 Ops/s 808.1635 Ops/s $\color{#d91a1a}-4.10\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.1121ms 5.9833ms 167.1327 Ops/s 166.1156 Ops/s $\color{#35bf28}+0.61\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7349ms 0.4598ms 2.1747 KOps/s 2.0459 KOps/s $\textbf{\color{#35bf28}+6.30\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6441ms 0.4406ms 2.2694 KOps/s 2.0302 KOps/s $\textbf{\color{#35bf28}+11.78\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.0967ms 5.8446ms 171.0984 Ops/s 169.2418 Ops/s $\color{#35bf28}+1.10\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.7280ms 0.2868ms 3.4874 KOps/s 3.0293 KOps/s $\textbf{\color{#35bf28}+15.12\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4780ms 0.2684ms 3.7263 KOps/s 3.4715 KOps/s $\textbf{\color{#35bf28}+7.34\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0845ms 5.8050ms 172.2667 Ops/s 172.3627 Ops/s $\color{#d91a1a}-0.06\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1016ms 0.2854ms 3.5038 KOps/s 626.1894 Ops/s $\textbf{\color{#35bf28}+459.55\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4576ms 0.2632ms 3.7990 KOps/s 2.9512 KOps/s $\textbf{\color{#35bf28}+28.73\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.2854ms 6.0164ms 166.2130 Ops/s 165.2191 Ops/s $\color{#35bf28}+0.60\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9838ms 0.4784ms 2.0904 KOps/s 2.1873 KOps/s $\color{#d91a1a}-4.43\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.8010ms 0.5285ms 1.8922 KOps/s 2.1648 KOps/s $\textbf{\color{#d91a1a}-12.59\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.6290s 17.5585ms 56.9524 Ops/s 194.2651 Ops/s $\textbf{\color{#d91a1a}-70.68\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 2.4618ms 1.4542ms 687.6511 Ops/s 472.6978 Ops/s $\textbf{\color{#35bf28}+45.47\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.0479ms 1.0743ms 930.8345 Ops/s 778.0051 Ops/s $\textbf{\color{#35bf28}+19.64\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 7.4922ms 5.0790ms 196.8874 Ops/s 193.9093 Ops/s $\color{#35bf28}+1.54\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.3385ms 2.0610ms 485.2114 Ops/s 473.1431 Ops/s $\color{#35bf28}+2.55\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 7.6644ms 1.2362ms 808.9309 Ops/s 830.0041 Ops/s $\color{#d91a1a}-2.54\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 6.8216ms 5.3070ms 188.4317 Ops/s 53.3984 Ops/s $\textbf{\color{#35bf28}+252.88\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 9.4375ms 2.2797ms 438.6578 Ops/s 462.5368 Ops/s $\textbf{\color{#d91a1a}-5.16\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.2077ms 1.3631ms 733.6066 Ops/s 986.6755 Ops/s $\textbf{\color{#d91a1a}-25.65\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 38.5226ms 35.1052ms 28.4858 Ops/s 28.8758 Ops/s $\color{#d91a1a}-1.35\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.9963ms 18.0502ms 55.4011 Ops/s 56.2145 Ops/s $\color{#d91a1a}-1.45\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 38.0684ms 35.7612ms 27.9632 Ops/s 27.8946 Ops/s $\color{#35bf28}+0.25\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.8263ms 18.2870ms 54.6836 Ops/s 55.0507 Ops/s $\color{#d91a1a}-0.67\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 39.2598ms 37.5568ms 26.6264 Ops/s 26.3522 Ops/s $\color{#35bf28}+1.04\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 21.3280ms 20.0043ms 49.9892 Ops/s 51.2011 Ops/s $\color{#d91a1a}-2.37\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens