Skip to content

[Refactor,Test] Move compile test to dedicated folder #3314

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
vmoens merged 2 commits into from
Jan 8, 2026
Merged

[Refactor,Test] Move compile test to dedicated folder #3314

vmoens merged 2 commits into from
Jan 8, 2026

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Jan 8, 2026 •
edited
Loading

@vmoens
Update
9feabfd 
[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Jan 8, 2026 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3314

Note: Links to docs will display an error until the docs builds have been completed.

⏳ No Failures, 45 Pending

As of commit 6cc26d3 with merge base cc917ba (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Jan 8, 2026
@vmoens
[Refactor,Test] Move compile test to dedicated folder
b3c97e9 
ghstack-source-id: 0873164
Pull-Request: #3314
This was referenced Jan 8, 2026
Merged
Merged
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 8, 2026
This was referenced Jan 8, 2026
Merged
Merged
vmoens added a commit that referenced this pull request Jan 8, 2026
@vmoens
[Refactor,Test] Move compile test to dedicated folder
0f901a7 
ghstack-source-id: 0873164
Pull-Request: #3314
@vmoens
Update
6cc26d3 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Jan 8, 2026
@vmoens
[Refactor,Test] Move compile test to dedicated folder
253b8dd 
ghstack-source-id: a4d56bd
Pull-Request: #3314
@vmoens vmoens merged commit 6cc26d3 into gh/vmoens/192/base Jan 8, 2026
54 of 73 checks passed
@vmoens vmoens deleted the gh/vmoens/192/head branch January 8, 2026 11:18
@github-actions
Copy link

github-actions bot commented Jan 8, 2026

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}28$. Worsened: $\large\color{#d91a1a}7$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 83.2759μs 82.3899μs 12.1374 KOps/s 11.6659 KOps/s $\color{#35bf28}+4.04\%$
test_tensor_to_bytestream_speed[torch.save] 0.1420ms 0.1417ms 7.0556 KOps/s 6.8863 KOps/s $\color{#35bf28}+2.46\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1197s 0.1190s 8.4047 Ops/s 8.4092 Ops/s $\color{#d91a1a}-0.05\%$
test_tensor_to_bytestream_speed[numpy] 2.7274μs 2.7208μs 367.5434 KOps/s 368.7714 KOps/s $\color{#d91a1a}-0.33\%$
test_tensor_to_bytestream_speed[safetensors] 39.2802μs 39.0974μs 25.5771 KOps/s 24.4558 KOps/s $\color{#35bf28}+4.59\%$
test_simple 0.5570s 0.5551s 1.8016 Ops/s 1.7041 Ops/s $\textbf{\color{#35bf28}+5.72\%}$
test_transformed 1.1420s 1.1398s 0.8773 Ops/s 0.8511 Ops/s $\color{#35bf28}+3.09\%$
test_serial 1.6844s 1.6822s 0.5945 Ops/s 0.5780 Ops/s $\color{#35bf28}+2.85\%$
test_parallel 1.3020s 1.1806s 0.8470 Ops/s 0.8501 Ops/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[True-True-True-True-True] 0.3103ms 45.8504μs 21.8100 KOps/s 22.1130 KOps/s $\color{#d91a1a}-1.37\%$
test_step_mdp_speed[True-True-True-True-False] 91.2310μs 25.7948μs 38.7675 KOps/s 38.7017 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[True-True-True-False-True] 56.8410μs 26.0253μs 38.4242 KOps/s 37.9907 KOps/s $\color{#35bf28}+1.14\%$
test_step_mdp_speed[True-True-True-False-False] 44.4210μs 14.2786μs 70.0351 KOps/s 68.8559 KOps/s $\color{#35bf28}+1.71\%$
test_step_mdp_speed[True-True-False-True-True] 93.4920μs 49.8410μs 20.0638 KOps/s 20.1009 KOps/s $\color{#d91a1a}-0.18\%$
test_step_mdp_speed[True-True-False-True-False] 62.3010μs 28.7664μs 34.7628 KOps/s 34.6469 KOps/s $\color{#35bf28}+0.33\%$
test_step_mdp_speed[True-True-False-False-True] 60.2210μs 29.1574μs 34.2966 KOps/s 34.3729 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[True-True-False-False-False] 48.3010μs 17.1040μs 58.4658 KOps/s 57.5132 KOps/s $\color{#35bf28}+1.66\%$
test_step_mdp_speed[True-False-True-True-True] 83.8620μs 52.0125μs 19.2262 KOps/s 19.0246 KOps/s $\color{#35bf28}+1.06\%$
test_step_mdp_speed[True-False-True-True-False] 58.6910μs 31.7129μs 31.5329 KOps/s 31.3664 KOps/s $\color{#35bf28}+0.53\%$
test_step_mdp_speed[True-False-True-False-True] 65.4610μs 28.8269μs 34.6899 KOps/s 34.6683 KOps/s $\color{#35bf28}+0.06\%$
test_step_mdp_speed[True-False-True-False-False] 45.7110μs 17.0647μs 58.6007 KOps/s 58.1899 KOps/s $\color{#35bf28}+0.71\%$
test_step_mdp_speed[True-False-False-True-True] 92.2510μs 55.1849μs 18.1209 KOps/s 18.1859 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[True-False-False-True-False] 63.9510μs 34.5883μs 28.9115 KOps/s 29.1482 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[True-False-False-False-True] 58.5210μs 31.2164μs 32.0345 KOps/s 31.0721 KOps/s $\color{#35bf28}+3.10\%$
test_step_mdp_speed[True-False-False-False-False] 51.2710μs 19.9040μs 50.2412 KOps/s 49.9534 KOps/s $\color{#35bf28}+0.58\%$
test_step_mdp_speed[False-True-True-True-True] 80.8710μs 52.3547μs 19.1005 KOps/s 19.0606 KOps/s $\color{#35bf28}+0.21\%$
test_step_mdp_speed[False-True-True-True-False] 59.3810μs 31.4715μs 31.7748 KOps/s 31.4184 KOps/s $\color{#35bf28}+1.13\%$
test_step_mdp_speed[False-True-True-False-True] 2.2603ms 33.1842μs 30.1348 KOps/s 29.8796 KOps/s $\color{#35bf28}+0.85\%$
test_step_mdp_speed[False-True-True-False-False] 40.5610μs 18.9989μs 52.6345 KOps/s 52.6152 KOps/s $\color{#35bf28}+0.04\%$
test_step_mdp_speed[False-True-False-True-True] 84.8710μs 55.0650μs 18.1604 KOps/s 18.0887 KOps/s $\color{#35bf28}+0.40\%$
test_step_mdp_speed[False-True-False-True-False] 66.2810μs 34.4228μs 29.0506 KOps/s 29.2179 KOps/s $\color{#d91a1a}-0.57\%$
test_step_mdp_speed[False-True-False-False-True] 69.6910μs 35.0985μs 28.4913 KOps/s 28.0189 KOps/s $\color{#35bf28}+1.69\%$
test_step_mdp_speed[False-True-False-False-False] 52.3410μs 21.8398μs 45.7879 KOps/s 46.6796 KOps/s $\color{#d91a1a}-1.91\%$
test_step_mdp_speed[False-False-True-True-True] 91.6810μs 57.5852μs 17.3656 KOps/s 17.4286 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[False-False-True-True-False] 72.4210μs 37.2593μs 26.8389 KOps/s 26.8990 KOps/s $\color{#d91a1a}-0.22\%$
test_step_mdp_speed[False-False-True-False-True] 68.6410μs 35.0696μs 28.5147 KOps/s 28.7888 KOps/s $\color{#d91a1a}-0.95\%$
test_step_mdp_speed[False-False-True-False-False] 48.4610μs 21.5903μs 46.3172 KOps/s 46.3839 KOps/s $\color{#d91a1a}-0.14\%$
test_step_mdp_speed[False-False-False-True-True] 92.5220μs 59.8016μs 16.7220 KOps/s 16.8853 KOps/s $\color{#d91a1a}-0.97\%$
test_step_mdp_speed[False-False-False-True-False] 68.6310μs 39.4051μs 25.3774 KOps/s 25.3775 KOps/s $-0.00\%$
test_step_mdp_speed[False-False-False-False-True] 87.0010μs 37.8411μs 26.4263 KOps/s 26.9512 KOps/s $\color{#d91a1a}-1.95\%$
test_step_mdp_speed[False-False-False-False-False] 52.2910μs 24.5954μs 40.6580 KOps/s 42.1179 KOps/s $\color{#d91a1a}-3.47\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8834s 0.7876s 1.2697 Ops/s 1.2570 Ops/s $\color{#35bf28}+1.01\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7475s 0.6510s 1.5362 Ops/s 1.5247 Ops/s $\color{#35bf28}+0.75\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.8018s 1.7219s 0.5807 Ops/s 0.5753 Ops/s $\color{#35bf28}+0.94\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5731s 1.4919s 0.6703 Ops/s 0.6620 Ops/s $\color{#35bf28}+1.25\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 2.0574s 1.9791s 0.5053 Ops/s 0.5032 Ops/s $\color{#35bf28}+0.41\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.8298s 1.7505s 0.5713 Ops/s 0.5671 Ops/s $\color{#35bf28}+0.73\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.8552s 4.7638s 0.2099 Ops/s 0.2116 Ops/s $\color{#d91a1a}-0.81\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.6592s 4.5704s 0.2188 Ops/s 0.2197 Ops/s $\color{#d91a1a}-0.42\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.2174s 2.0334s 0.4918 Ops/s 0.4951 Ops/s $\color{#d91a1a}-0.67\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.8350s 1.7366s 0.5758 Ops/s 0.5885 Ops/s $\color{#d91a1a}-2.15\%$
test_values[generalized_advantage_estimate-True-True] 10.4209ms 9.9003ms 101.0073 Ops/s 100.4164 Ops/s $\color{#35bf28}+0.59\%$
test_values[vec_generalized_advantage_estimate-True-True] 19.9393ms 17.5501ms 56.9796 Ops/s 56.5205 Ops/s $\color{#35bf28}+0.81\%$
test_values[td0_return_estimate-False-False] 0.2318ms 0.1293ms 7.7328 KOps/s 7.8113 KOps/s $\color{#d91a1a}-1.00\%$
test_values[td1_return_estimate-False-False] 28.3966ms 27.3698ms 36.5367 Ops/s 36.7592 Ops/s $\color{#d91a1a}-0.61\%$
test_values[vec_td1_return_estimate-False-False] 18.7355ms 17.6262ms 56.7338 Ops/s 56.4179 Ops/s $\color{#35bf28}+0.56\%$
test_values[td_lambda_return_estimate-True-False] 41.3287ms 40.1533ms 24.9046 Ops/s 24.7902 Ops/s $\color{#35bf28}+0.46\%$
test_values[vec_td_lambda_return_estimate-True-False] 20.3849ms 17.6388ms 56.6931 Ops/s 56.5052 Ops/s $\color{#35bf28}+0.33\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 8.8918ms 8.7497ms 114.2894 Ops/s 112.0275 Ops/s $\color{#35bf28}+2.02\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7198ms 1.5319ms 652.7844 Ops/s 678.9343 Ops/s $\color{#d91a1a}-3.85\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4779ms 0.4073ms 2.4555 KOps/s 2.4530 KOps/s $\color{#35bf28}+0.10\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 35.1972ms 34.4975ms 28.9876 Ops/s 30.1763 Ops/s $\color{#d91a1a}-3.94\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.9845ms 1.7575ms 568.9972 Ops/s 582.2753 Ops/s $\color{#d91a1a}-2.28\%$
test_dqn_speed[False-None] 1.5890ms 1.3912ms 718.8274 Ops/s 704.9128 Ops/s $\color{#35bf28}+1.97\%$
test_dqn_speed[False-backward] 1.9439ms 1.8873ms 529.8699 Ops/s 522.1694 Ops/s $\color{#35bf28}+1.47\%$
test_dqn_speed[True-None] 0.6818ms 0.5303ms 1.8858 KOps/s 1.7881 KOps/s $\textbf{\color{#35bf28}+5.47\%}$
test_dqn_speed[True-backward] 1.0143ms 0.9742ms 1.0265 KOps/s 993.8930 Ops/s $\color{#35bf28}+3.28\%$
test_dqn_speed[reduce-overhead-None] 0.6257ms 0.5264ms 1.8997 KOps/s 1.8449 KOps/s $\color{#35bf28}+2.97\%$
test_dqn_speed[reduce-overhead-backward] 0.9997ms 0.9625ms 1.0390 KOps/s 1.0261 KOps/s $\color{#35bf28}+1.25\%$
test_ddpg_speed[False-None] 3.2103ms 2.8500ms 350.8828 Ops/s 345.4406 Ops/s $\color{#35bf28}+1.58\%$
test_ddpg_speed[False-backward] 4.1456ms 4.0255ms 248.4139 Ops/s 243.4555 Ops/s $\color{#35bf28}+2.04\%$
test_ddpg_speed[True-None] 1.5069ms 1.3894ms 719.7334 Ops/s 712.1511 Ops/s $\color{#35bf28}+1.06\%$
test_ddpg_speed[True-backward] 2.4166ms 2.3479ms 425.9061 Ops/s 370.9116 Ops/s $\textbf{\color{#35bf28}+14.83\%}$
test_ddpg_speed[reduce-overhead-None] 1.5380ms 1.3789ms 725.2024 Ops/s 726.4789 Ops/s $\color{#d91a1a}-0.18\%$
test_ddpg_speed[reduce-overhead-backward] 2.4488ms 2.3484ms 425.8271 Ops/s 425.3610 Ops/s $\color{#35bf28}+0.11\%$
test_sac_speed[False-None] 8.3456ms 7.8415ms 127.5270 Ops/s 121.3936 Ops/s $\textbf{\color{#35bf28}+5.05\%}$
test_sac_speed[False-backward] 11.3789ms 10.9616ms 91.2278 Ops/s 90.8156 Ops/s $\color{#35bf28}+0.45\%$
test_sac_speed[True-None] 2.5326ms 2.1265ms 470.2474 Ops/s 469.5082 Ops/s $\color{#35bf28}+0.16\%$
test_sac_speed[True-backward] 4.0971ms 3.9919ms 250.5091 Ops/s 244.1817 Ops/s $\color{#35bf28}+2.59\%$
test_sac_speed[reduce-overhead-None] 2.3722ms 2.1187ms 471.9867 Ops/s 448.9599 Ops/s $\textbf{\color{#35bf28}+5.13\%}$
test_sac_speed[reduce-overhead-backward] 4.0914ms 3.9768ms 251.4576 Ops/s 226.9592 Ops/s $\textbf{\color{#35bf28}+10.79\%}$
test_redq_speed[False-None] 10.8641ms 10.3539ms 96.5823 Ops/s 91.2916 Ops/s $\textbf{\color{#35bf28}+5.80\%}$
test_redq_speed[False-backward] 21.8427ms 17.8602ms 55.9904 Ops/s 56.5665 Ops/s $\color{#d91a1a}-1.02\%$
test_redq_speed[True-None] 5.2432ms 4.4606ms 224.1871 Ops/s 210.4893 Ops/s $\textbf{\color{#35bf28}+6.51\%}$
test_redq_speed[True-backward] 10.0832ms 9.8417ms 101.6087 Ops/s 104.7688 Ops/s $\color{#d91a1a}-3.02\%$
test_redq_speed[reduce-overhead-None] 5.0059ms 4.4306ms 225.7025 Ops/s 219.1184 Ops/s $\color{#35bf28}+3.00\%$
test_redq_speed[reduce-overhead-backward] 10.2079ms 9.8353ms 101.6750 Ops/s 97.4410 Ops/s $\color{#35bf28}+4.35\%$
test_redq_deprec_speed[False-None] 11.5623ms 11.0685ms 90.3461 Ops/s 90.0615 Ops/s $\color{#35bf28}+0.32\%$
test_redq_deprec_speed[False-backward] 16.1422ms 15.7979ms 63.2997 Ops/s 63.4879 Ops/s $\color{#d91a1a}-0.30\%$
test_redq_deprec_speed[True-None] 3.9805ms 3.6329ms 275.2649 Ops/s 262.2374 Ops/s $\color{#35bf28}+4.97\%$
test_redq_deprec_speed[True-backward] 7.8139ms 7.5840ms 131.8558 Ops/s 115.1575 Ops/s $\textbf{\color{#35bf28}+14.50\%}$
test_redq_deprec_speed[reduce-overhead-None] 3.9899ms 3.5807ms 279.2748 Ops/s 280.1358 Ops/s $\color{#d91a1a}-0.31\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.8882ms 7.6038ms 131.5132 Ops/s 132.9617 Ops/s $\color{#d91a1a}-1.09\%$
test_td3_speed[False-None] 8.1700ms 7.9550ms 125.7069 Ops/s 125.3234 Ops/s $\color{#35bf28}+0.31\%$
test_td3_speed[False-backward] 11.2295ms 10.7309ms 93.1892 Ops/s 51.4875 Ops/s $\textbf{\color{#35bf28}+80.99\%}$
test_td3_speed[True-None] 1.8573ms 1.8107ms 552.2676 Ops/s 545.5298 Ops/s $\color{#35bf28}+1.24\%$
test_td3_speed[True-backward] 3.8075ms 3.6459ms 274.2772 Ops/s 275.9355 Ops/s $\color{#d91a1a}-0.60\%$
test_td3_speed[reduce-overhead-None] 1.8218ms 1.7759ms 563.0912 Ops/s 559.6948 Ops/s $\color{#35bf28}+0.61\%$
test_td3_speed[reduce-overhead-backward] 3.7914ms 3.6595ms 273.2594 Ops/s 234.5388 Ops/s $\textbf{\color{#35bf28}+16.51\%}$
test_cql_speed[False-None] 29.0881ms 26.0866ms 38.3339 Ops/s 38.2080 Ops/s $\color{#35bf28}+0.33\%$
test_cql_speed[False-backward] 38.1863ms 35.2896ms 28.3370 Ops/s 27.5559 Ops/s $\color{#35bf28}+2.83\%$
test_cql_speed[True-None] 12.9488ms 12.3719ms 80.8285 Ops/s 79.6106 Ops/s $\color{#35bf28}+1.53\%$
test_cql_speed[True-backward] 18.8794ms 18.3842ms 54.3944 Ops/s 55.6656 Ops/s $\color{#d91a1a}-2.28\%$
test_cql_speed[reduce-overhead-None] 12.8470ms 12.4152ms 80.5463 Ops/s 81.3437 Ops/s $\color{#d91a1a}-0.98\%$
test_cql_speed[reduce-overhead-backward] 18.8227ms 18.3516ms 54.4912 Ops/s 54.5664 Ops/s $\color{#d91a1a}-0.14\%$
test_a2c_speed[False-None] 6.2478ms 5.4758ms 182.6225 Ops/s 180.2805 Ops/s $\color{#35bf28}+1.30\%$
test_a2c_speed[False-backward] 12.1743ms 11.7664ms 84.9876 Ops/s 84.1894 Ops/s $\color{#35bf28}+0.95\%$
test_a2c_speed[True-None] 4.2605ms 3.7617ms 265.8393 Ops/s 265.4640 Ops/s $\color{#35bf28}+0.14\%$
test_a2c_speed[True-backward] 8.7063ms 8.4428ms 118.4443 Ops/s 117.0388 Ops/s $\color{#35bf28}+1.20\%$
test_a2c_speed[reduce-overhead-None] 3.8814ms 3.7281ms 268.2299 Ops/s 269.2957 Ops/s $\color{#d91a1a}-0.40\%$
test_a2c_speed[reduce-overhead-backward] 8.9276ms 8.7274ms 114.5818 Ops/s 114.3314 Ops/s $\color{#35bf28}+0.22\%$
test_ppo_speed[False-None] 6.3484ms 5.9210ms 168.8898 Ops/s 167.4707 Ops/s $\color{#35bf28}+0.85\%$
test_ppo_speed[False-backward] 12.5713ms 12.2976ms 81.3168 Ops/s 81.3150 Ops/s $+0.00\%$
test_ppo_speed[True-None] 3.8050ms 3.6609ms 273.1546 Ops/s 271.2874 Ops/s $\color{#35bf28}+0.69\%$
test_ppo_speed[True-backward] 8.6049ms 8.4681ms 118.0903 Ops/s 97.4761 Ops/s $\textbf{\color{#35bf28}+21.15\%}$
test_ppo_speed[reduce-overhead-None] 4.0384ms 3.6399ms 274.7360 Ops/s 272.2951 Ops/s $\color{#35bf28}+0.90\%$
test_ppo_speed[reduce-overhead-backward] 9.2663ms 8.6222ms 115.9802 Ops/s 95.2397 Ops/s $\textbf{\color{#35bf28}+21.78\%}$
test_reinforce_speed[False-None] 4.7229ms 4.4822ms 223.1067 Ops/s 179.0792 Ops/s $\textbf{\color{#35bf28}+24.59\%}$
test_reinforce_speed[False-backward] 7.5080ms 7.2420ms 138.0829 Ops/s 127.1646 Ops/s $\textbf{\color{#35bf28}+8.59\%}$
test_reinforce_speed[True-None] 3.3556ms 2.8975ms 345.1270 Ops/s 336.7563 Ops/s $\color{#35bf28}+2.49\%$
test_reinforce_speed[True-backward] 7.8666ms 7.6930ms 129.9884 Ops/s 123.2675 Ops/s $\textbf{\color{#35bf28}+5.45\%}$
test_reinforce_speed[reduce-overhead-None] 3.1335ms 2.8747ms 347.8632 Ops/s 349.7120 Ops/s $\color{#d91a1a}-0.53\%$
test_reinforce_speed[reduce-overhead-backward] 8.2279ms 7.9449ms 125.8669 Ops/s 118.6796 Ops/s $\textbf{\color{#35bf28}+6.06\%}$
test_iql_speed[False-None] 20.4400ms 19.7858ms 50.5413 Ops/s 49.8224 Ops/s $\color{#35bf28}+1.44\%$
test_iql_speed[False-backward] 31.1824ms 30.2252ms 33.0849 Ops/s 32.8407 Ops/s $\color{#35bf28}+0.74\%$
test_iql_speed[True-None] 8.8529ms 8.5441ms 117.0395 Ops/s 116.8076 Ops/s $\color{#35bf28}+0.20\%$
test_iql_speed[True-backward] 17.5199ms 16.7996ms 59.5251 Ops/s 60.2082 Ops/s $\color{#d91a1a}-1.13\%$
test_iql_speed[reduce-overhead-None] 9.0130ms 8.5618ms 116.7978 Ops/s 116.6424 Ops/s $\color{#35bf28}+0.13\%$
test_iql_speed[reduce-overhead-backward] 17.5844ms 17.2682ms 57.9099 Ops/s 58.7370 Ops/s $\color{#d91a1a}-1.41\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 8.1686ms 6.2527ms 159.9307 Ops/s 159.1741 Ops/s $\color{#35bf28}+0.48\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.5380ms 0.2854ms 3.5040 KOps/s 2.6084 KOps/s $\textbf{\color{#35bf28}+34.33\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6120ms 0.2691ms 3.7167 KOps/s 2.7622 KOps/s $\textbf{\color{#35bf28}+34.55\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1976ms 5.9220ms 168.8614 Ops/s 165.1190 Ops/s $\color{#35bf28}+2.27\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1170ms 0.3058ms 3.2702 KOps/s 2.7196 KOps/s $\textbf{\color{#35bf28}+20.25\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.6601ms 0.3023ms 3.3081 KOps/s 2.6901 KOps/s $\textbf{\color{#35bf28}+22.97\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7257ms 1.3753ms 727.0939 Ops/s 684.1378 Ops/s $\textbf{\color{#35bf28}+6.28\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.5825ms 1.2724ms 785.9451 Ops/s 729.5395 Ops/s $\textbf{\color{#35bf28}+7.73\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 10.2198ms 6.2591ms 159.7671 Ops/s 160.1948 Ops/s $\color{#d91a1a}-0.27\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.7876ms 0.4813ms 2.0775 KOps/s 1.8616 KOps/s $\textbf{\color{#35bf28}+11.59\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7600ms 0.4616ms 2.1663 KOps/s 2.2146 KOps/s $\color{#d91a1a}-2.18\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.1673ms 5.8906ms 169.7631 Ops/s 164.4065 Ops/s $\color{#35bf28}+3.26\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.7438ms 0.4270ms 2.3419 KOps/s 3.1103 KOps/s $\textbf{\color{#d91a1a}-24.71\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6511ms 0.4128ms 2.4224 KOps/s 3.6714 KOps/s $\textbf{\color{#d91a1a}-34.02\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.2130ms 5.8648ms 170.5101 Ops/s 166.0967 Ops/s $\color{#35bf28}+2.66\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 2.0567ms 0.4198ms 2.3823 KOps/s 3.5115 KOps/s $\textbf{\color{#d91a1a}-32.16\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5759ms 0.4001ms 2.4995 KOps/s 3.7580 KOps/s $\textbf{\color{#d91a1a}-33.49\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.0703ms 5.9924ms 166.8777 Ops/s 161.9168 Ops/s $\color{#35bf28}+3.06\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.9038ms 0.4598ms 2.1747 KOps/s 1.9995 KOps/s $\textbf{\color{#35bf28}+8.76\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6479ms 0.4451ms 2.2466 KOps/s 2.2123 KOps/s $\color{#35bf28}+1.55\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.5078ms 5.0827ms 196.7460 Ops/s 50.7464 Ops/s $\textbf{\color{#35bf28}+287.70\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 9.4814ms 2.2901ms 436.6599 Ops/s 470.6515 Ops/s $\textbf{\color{#d91a1a}-7.22\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 7.2658ms 1.2120ms 825.0635 Ops/s 833.2977 Ops/s $\color{#d91a1a}-0.99\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.6302s 18.0313ms 55.4593 Ops/s 192.8363 Ops/s $\textbf{\color{#d91a1a}-71.24\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 10.4798ms 2.1261ms 470.3439 Ops/s 471.4107 Ops/s $\color{#d91a1a}-0.23\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 3.3371ms 1.1193ms 893.4432 Ops/s 806.5698 Ops/s $\textbf{\color{#35bf28}+10.77\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 9.5868ms 5.3806ms 185.8516 Ops/s 53.7259 Ops/s $\textbf{\color{#35bf28}+245.93\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 6.9278ms 2.2497ms 444.4954 Ops/s 431.4940 Ops/s $\color{#35bf28}+3.01\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 9.2152ms 1.4061ms 711.1742 Ops/s 974.6992 Ops/s $\textbf{\color{#d91a1a}-27.04\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 38.3844ms 35.5297ms 28.1454 Ops/s 28.4520 Ops/s $\color{#d91a1a}-1.08\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 20.0989ms 17.9256ms 55.7862 Ops/s 56.4528 Ops/s $\color{#d91a1a}-1.18\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 38.9177ms 36.1287ms 27.6788 Ops/s 27.2425 Ops/s $\color{#35bf28}+1.60\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 20.1457ms 18.2863ms 54.6859 Ops/s 55.4191 Ops/s $\color{#d91a1a}-1.32\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 39.0249ms 37.6361ms 26.5702 Ops/s 26.2470 Ops/s $\color{#35bf28}+1.23\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 21.6343ms 20.1137ms 49.7173 Ops/s 49.8801 Ops/s $\color{#d91a1a}-0.33\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens