Skip to content

[Test] Use spawn in older pytorch #3285

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
vmoens merged 6 commits into from
Jan 1, 2026
Merged

[Test] Use spawn in older pytorch #3285

vmoens merged 6 commits into from
Jan 1, 2026

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 31, 2025 •
edited
Loading

@vmoens
Update
d7b82c3 
[ghstack-poisoned]
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 31, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3285

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

❌ 4 New Failures, 2 Pending, 17 Unrelated Failures

As of commit a05f1c4 with merge base 7866d11 (image):

NEW FAILURES - The following jobs have failed:

FLAKY - The following jobs failed but were likely due to flakiness present on trunk:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

vmoens added a commit that referenced this pull request Dec 31, 2025
@vmoens
[Test] Use spawn in older pytorch
5609593 
ghstack-source-id: 7377fdb
Pull-Request: #3285
This was referenced Dec 31, 2025
Merged
Merged
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 31, 2025
@vmoens vmoens mentioned this pull request Dec 31, 2025
Merged
@github-actions
Copy link

github-actions bot commented Dec 31, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}17$. Worsened: $\large\color{#d91a1a}14$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 81.1662μs 79.8413μs 12.5248 KOps/s 12.4108 KOps/s $\color{#35bf28}+0.92\%$
test_tensor_to_bytestream_speed[torch.save] 0.1391ms 0.1384ms 7.2269 KOps/s 7.2049 KOps/s $\color{#35bf28}+0.30\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1243s 0.1241s 8.0568 Ops/s 8.0571 Ops/s $-0.00\%$
test_tensor_to_bytestream_speed[numpy] 2.7992μs 2.7963μs 357.6169 KOps/s 356.7966 KOps/s $\color{#35bf28}+0.23\%$
test_tensor_to_bytestream_speed[safetensors] 38.0781μs 37.9803μs 26.3294 KOps/s 26.4028 KOps/s $\color{#d91a1a}-0.28\%$
test_simple 0.5489s 0.5483s 1.8238 Ops/s 1.7178 Ops/s $\textbf{\color{#35bf28}+6.17\%}$
test_transformed 1.1226s 1.1215s 0.8917 Ops/s 0.8674 Ops/s $\color{#35bf28}+2.80\%$
test_serial 1.6684s 1.6613s 0.6019 Ops/s 0.5941 Ops/s $\color{#35bf28}+1.33\%$
test_parallel 1.2867s 1.1949s 0.8369 Ops/s 0.8684 Ops/s $\color{#d91a1a}-3.62\%$
test_step_mdp_speed[True-True-True-True-True] 0.3295ms 44.6503μs 22.3963 KOps/s 21.8733 KOps/s $\color{#35bf28}+2.39\%$
test_step_mdp_speed[True-True-True-True-False] 56.2210μs 25.0532μs 39.9151 KOps/s 40.2723 KOps/s $\color{#d91a1a}-0.89\%$
test_step_mdp_speed[True-True-True-False-True] 66.9910μs 24.8025μs 40.3185 KOps/s 39.0408 KOps/s $\color{#35bf28}+3.27\%$
test_step_mdp_speed[True-True-True-False-False] 49.9810μs 13.9480μs 71.6950 KOps/s 72.0502 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[True-True-False-True-True] 93.6510μs 48.1018μs 20.7892 KOps/s 20.7460 KOps/s $\color{#35bf28}+0.21\%$
test_step_mdp_speed[True-True-False-True-False] 57.5710μs 27.6648μs 36.1470 KOps/s 36.2092 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[True-True-False-False-True] 61.8320μs 27.8671μs 35.8846 KOps/s 36.0240 KOps/s $\color{#d91a1a}-0.39\%$
test_step_mdp_speed[True-True-False-False-False] 49.5010μs 16.9394μs 59.0340 KOps/s 60.5324 KOps/s $\color{#d91a1a}-2.48\%$
test_step_mdp_speed[True-False-True-True-True] 82.5420μs 50.3154μs 19.8746 KOps/s 19.9606 KOps/s $\color{#d91a1a}-0.43\%$
test_step_mdp_speed[True-False-True-True-False] 59.3710μs 30.6504μs 32.6260 KOps/s 32.7109 KOps/s $\color{#d91a1a}-0.26\%$
test_step_mdp_speed[True-False-True-False-True] 61.0110μs 28.1922μs 35.4708 KOps/s 36.2125 KOps/s $\color{#d91a1a}-2.05\%$
test_step_mdp_speed[True-False-True-False-False] 43.1210μs 16.9141μs 59.1222 KOps/s 61.0298 KOps/s $\color{#d91a1a}-3.13\%$
test_step_mdp_speed[True-False-False-True-True] 80.8510μs 54.0341μs 18.5068 KOps/s 19.1040 KOps/s $\color{#d91a1a}-3.13\%$
test_step_mdp_speed[True-False-False-True-False] 57.7010μs 32.9861μs 30.3158 KOps/s 30.3931 KOps/s $\color{#d91a1a}-0.25\%$
test_step_mdp_speed[True-False-False-False-True] 85.6520μs 30.5055μs 32.7810 KOps/s 33.0502 KOps/s $\color{#d91a1a}-0.81\%$
test_step_mdp_speed[True-False-False-False-False] 37.8100μs 19.6848μs 50.8005 KOps/s 52.2257 KOps/s $\color{#d91a1a}-2.73\%$
test_step_mdp_speed[False-True-True-True-True] 88.3420μs 50.4225μs 19.8324 KOps/s 19.7878 KOps/s $\color{#35bf28}+0.23\%$
test_step_mdp_speed[False-True-True-True-False] 60.9910μs 30.3736μs 32.9233 KOps/s 32.9760 KOps/s $\color{#d91a1a}-0.16\%$
test_step_mdp_speed[False-True-True-False-True] 2.3072ms 32.6827μs 30.5973 KOps/s 31.7937 KOps/s $\color{#d91a1a}-3.76\%$
test_step_mdp_speed[False-True-True-False-False] 49.0800μs 18.4475μs 54.2079 KOps/s 55.1105 KOps/s $\color{#d91a1a}-1.64\%$
test_step_mdp_speed[False-True-False-True-True] 0.1009ms 53.3747μs 18.7355 KOps/s 19.3907 KOps/s $\color{#d91a1a}-3.38\%$
test_step_mdp_speed[False-True-False-True-False] 84.8620μs 33.6041μs 29.7582 KOps/s 30.6302 KOps/s $\color{#d91a1a}-2.85\%$
test_step_mdp_speed[False-True-False-False-True] 60.1210μs 34.9224μs 28.6349 KOps/s 29.3183 KOps/s $\color{#d91a1a}-2.33\%$
test_step_mdp_speed[False-True-False-False-False] 57.5410μs 20.6994μs 48.3106 KOps/s 47.7564 KOps/s $\color{#35bf28}+1.16\%$
test_step_mdp_speed[False-False-True-True-True] 98.3210μs 54.6727μs 18.2907 KOps/s 18.3102 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[False-False-True-True-False] 69.3210μs 36.0434μs 27.7443 KOps/s 28.2626 KOps/s $\color{#d91a1a}-1.83\%$
test_step_mdp_speed[False-False-True-False-True] 58.3210μs 33.6515μs 29.7163 KOps/s 30.0047 KOps/s $\color{#d91a1a}-0.96\%$
test_step_mdp_speed[False-False-True-False-False] 46.9910μs 20.5243μs 48.7227 KOps/s 49.3172 KOps/s $\color{#d91a1a}-1.21\%$
test_step_mdp_speed[False-False-False-True-True] 95.4610μs 57.0558μs 17.5267 KOps/s 17.7016 KOps/s $\color{#d91a1a}-0.99\%$
test_step_mdp_speed[False-False-False-True-False] 71.8510μs 38.3303μs 26.0890 KOps/s 26.3559 KOps/s $\color{#d91a1a}-1.01\%$
test_step_mdp_speed[False-False-False-False-True] 77.2410μs 35.9623μs 27.8069 KOps/s 27.6934 KOps/s $\color{#35bf28}+0.41\%$
test_step_mdp_speed[False-False-False-False-False] 53.3110μs 23.4145μs 42.7085 KOps/s 43.0780 KOps/s $\color{#d91a1a}-0.86\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8826s 0.7829s 1.2774 Ops/s 1.2812 Ops/s $\color{#d91a1a}-0.30\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7428s 0.6455s 1.5492 Ops/s 1.5556 Ops/s $\color{#d91a1a}-0.41\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7980s 1.7183s 0.5820 Ops/s 0.5892 Ops/s $\color{#d91a1a}-1.23\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5678s 1.4823s 0.6746 Ops/s 0.6827 Ops/s $\color{#d91a1a}-1.19\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 2.0316s 1.9496s 0.5129 Ops/s 0.5161 Ops/s $\color{#d91a1a}-0.62\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.7963s 1.7122s 0.5841 Ops/s 0.5842 Ops/s $\color{#d91a1a}-0.02\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.7763s 4.6629s 0.2145 Ops/s 0.2158 Ops/s $\color{#d91a1a}-0.63\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.4998s 4.4698s 0.2237 Ops/s 0.2217 Ops/s $\color{#35bf28}+0.92\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0775s 1.9982s 0.5005 Ops/s 0.5085 Ops/s $\color{#d91a1a}-1.59\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.8443s 1.7103s 0.5847 Ops/s 0.5916 Ops/s $\color{#d91a1a}-1.17\%$
test_values[generalized_advantage_estimate-True-True] 10.6144ms 10.3793ms 96.3458 Ops/s 97.9755 Ops/s $\color{#d91a1a}-1.66\%$
test_values[vec_generalized_advantage_estimate-True-True] 19.4657ms 17.7312ms 56.3979 Ops/s 90.4031 Ops/s $\textbf{\color{#d91a1a}-37.62\%}$
test_values[td0_return_estimate-False-False] 0.2289ms 0.1236ms 8.0919 KOps/s 7.6151 KOps/s $\textbf{\color{#35bf28}+6.26\%}$
test_values[td1_return_estimate-False-False] 29.8327ms 28.0503ms 35.6502 Ops/s 35.8692 Ops/s $\color{#d91a1a}-0.61\%$
test_values[vec_td1_return_estimate-False-False] 18.7129ms 17.8743ms 55.9464 Ops/s 89.5637 Ops/s $\textbf{\color{#d91a1a}-37.53\%}$
test_values[td_lambda_return_estimate-True-False] 43.5979ms 41.3005ms 24.2128 Ops/s 24.3116 Ops/s $\color{#d91a1a}-0.41\%$
test_values[vec_td_lambda_return_estimate-True-False] 18.7060ms 17.8009ms 56.1771 Ops/s 89.8702 Ops/s $\textbf{\color{#d91a1a}-37.49\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.5301ms 9.2880ms 107.6657 Ops/s 110.7121 Ops/s $\color{#d91a1a}-2.75\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7018ms 1.4409ms 694.0161 Ops/s 660.3353 Ops/s $\textbf{\color{#35bf28}+5.10\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.4786ms 0.4303ms 2.3241 KOps/s 2.3294 KOps/s $\color{#d91a1a}-0.23\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.7918ms 33.8748ms 29.5205 Ops/s 53.4326 Ops/s $\textbf{\color{#d91a1a}-44.75\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 1.8418ms 1.7206ms 581.1852 Ops/s 583.8470 Ops/s $\color{#d91a1a}-0.46\%$
test_dqn_speed[False-None] 1.6406ms 1.4237ms 702.3853 Ops/s 711.4423 Ops/s $\color{#d91a1a}-1.27\%$
test_dqn_speed[False-backward] 2.0596ms 1.9815ms 504.6807 Ops/s 523.0750 Ops/s $\color{#d91a1a}-3.52\%$
test_dqn_speed[True-None] 0.7047ms 0.5226ms 1.9134 KOps/s 1.8600 KOps/s $\color{#35bf28}+2.87\%$
test_dqn_speed[True-backward] 1.0190ms 0.9777ms 1.0228 KOps/s 850.4061 Ops/s $\textbf{\color{#35bf28}+20.28\%}$
test_dqn_speed[reduce-overhead-None] 0.9022ms 0.5177ms 1.9317 KOps/s 1.8766 KOps/s $\color{#35bf28}+2.93\%$
test_dqn_speed[reduce-overhead-backward] 0.9971ms 0.9595ms 1.0422 KOps/s 873.4080 Ops/s $\textbf{\color{#35bf28}+19.33\%}$
test_ddpg_speed[False-None] 3.1332ms 2.8604ms 349.6054 Ops/s 337.9682 Ops/s $\color{#35bf28}+3.44\%$
test_ddpg_speed[False-backward] 4.1651ms 4.0612ms 246.2327 Ops/s 243.8410 Ops/s $\color{#35bf28}+0.98\%$
test_ddpg_speed[True-None] 1.5272ms 1.3785ms 725.4479 Ops/s 723.8742 Ops/s $\color{#35bf28}+0.22\%$
test_ddpg_speed[True-backward] 2.4220ms 2.3504ms 425.4605 Ops/s 382.5017 Ops/s $\textbf{\color{#35bf28}+11.23\%}$
test_ddpg_speed[reduce-overhead-None] 1.5064ms 1.3694ms 730.2213 Ops/s 732.4436 Ops/s $\color{#d91a1a}-0.30\%$
test_ddpg_speed[reduce-overhead-backward] 2.4535ms 2.3238ms 430.3320 Ops/s 412.6968 Ops/s $\color{#35bf28}+4.27\%$
test_sac_speed[False-None] 8.3625ms 7.9042ms 126.5152 Ops/s 125.5044 Ops/s $\color{#35bf28}+0.81\%$
test_sac_speed[False-backward] 11.7059ms 11.1735ms 89.4977 Ops/s 89.2601 Ops/s $\color{#35bf28}+0.27\%$
test_sac_speed[True-None] 2.2878ms 2.0999ms 476.2170 Ops/s 471.1887 Ops/s $\color{#35bf28}+1.07\%$
test_sac_speed[True-backward] 4.1274ms 3.9794ms 251.2952 Ops/s 228.5774 Ops/s $\textbf{\color{#35bf28}+9.94\%}$
test_sac_speed[reduce-overhead-None] 2.4070ms 2.1107ms 473.7661 Ops/s 461.8521 Ops/s $\color{#35bf28}+2.58\%$
test_sac_speed[reduce-overhead-backward] 4.0795ms 3.9567ms 252.7341 Ops/s 231.2159 Ops/s $\textbf{\color{#35bf28}+9.31\%}$
test_redq_speed[False-None] 15.1716ms 10.5833ms 94.4881 Ops/s 96.3717 Ops/s $\color{#d91a1a}-1.95\%$
test_redq_speed[False-backward] 18.6404ms 17.6999ms 56.4974 Ops/s 56.4595 Ops/s $\color{#35bf28}+0.07\%$
test_redq_speed[True-None] 4.5368ms 4.3385ms 230.4943 Ops/s 218.7547 Ops/s $\textbf{\color{#35bf28}+5.37\%}$
test_redq_speed[True-backward] 9.9755ms 9.6028ms 104.1359 Ops/s 105.7763 Ops/s $\color{#d91a1a}-1.55\%$
test_redq_speed[reduce-overhead-None] 4.6548ms 4.3458ms 230.1057 Ops/s 229.3503 Ops/s $\color{#35bf28}+0.33\%$
test_redq_speed[reduce-overhead-backward] 10.2853ms 9.8365ms 101.6626 Ops/s 102.9316 Ops/s $\color{#d91a1a}-1.23\%$
test_redq_deprec_speed[False-None] 11.5557ms 11.0622ms 90.3982 Ops/s 91.9438 Ops/s $\color{#d91a1a}-1.68\%$
test_redq_deprec_speed[False-backward] 16.8674ms 15.9601ms 62.6561 Ops/s 64.3081 Ops/s $\color{#d91a1a}-2.57\%$
test_redq_deprec_speed[True-None] 3.7318ms 3.5681ms 280.2591 Ops/s 288.0360 Ops/s $\color{#d91a1a}-2.70\%$
test_redq_deprec_speed[True-backward] 7.9209ms 7.6151ms 131.3183 Ops/s 140.0319 Ops/s $\textbf{\color{#d91a1a}-6.22\%}$
test_redq_deprec_speed[reduce-overhead-None] 3.7788ms 3.6004ms 277.7504 Ops/s 278.8710 Ops/s $\color{#d91a1a}-0.40\%$
test_redq_deprec_speed[reduce-overhead-backward] 7.8639ms 7.5308ms 132.7882 Ops/s 120.9647 Ops/s $\textbf{\color{#35bf28}+9.77\%}$
test_td3_speed[False-None] 8.3447ms 8.0241ms 124.6251 Ops/s 123.4013 Ops/s $\color{#35bf28}+0.99\%$
test_td3_speed[False-backward] 11.2787ms 10.8866ms 91.8559 Ops/s 91.3556 Ops/s $\color{#35bf28}+0.55\%$
test_td3_speed[True-None] 1.8271ms 1.7778ms 562.4777 Ops/s 558.1231 Ops/s $\color{#35bf28}+0.78\%$
test_td3_speed[True-backward] 3.6739ms 3.5515ms 281.5683 Ops/s 275.8913 Ops/s $\color{#35bf28}+2.06\%$
test_td3_speed[reduce-overhead-None] 1.7986ms 1.7588ms 568.5614 Ops/s 565.7600 Ops/s $\color{#35bf28}+0.50\%$
test_td3_speed[reduce-overhead-backward] 3.6835ms 3.5896ms 278.5804 Ops/s 277.4129 Ops/s $\color{#35bf28}+0.42\%$
test_cql_speed[False-None] 28.7409ms 25.8638ms 38.6640 Ops/s 38.0755 Ops/s $\color{#35bf28}+1.55\%$
test_cql_speed[False-backward] 39.4312ms 35.6191ms 28.0749 Ops/s 28.0331 Ops/s $\color{#35bf28}+0.15\%$
test_cql_speed[True-None] 12.6667ms 12.1881ms 82.0470 Ops/s 79.1731 Ops/s $\color{#35bf28}+3.63\%$
test_cql_speed[True-backward] 18.5178ms 18.1491ms 55.0991 Ops/s 54.2293 Ops/s $\color{#35bf28}+1.60\%$
test_cql_speed[reduce-overhead-None] 12.8598ms 12.3336ms 81.0793 Ops/s 79.5601 Ops/s $\color{#35bf28}+1.91\%$
test_cql_speed[reduce-overhead-backward] 18.4745ms 18.1081ms 55.2239 Ops/s 54.2465 Ops/s $\color{#35bf28}+1.80\%$
test_a2c_speed[False-None] 5.6659ms 5.3872ms 185.6239 Ops/s 185.0599 Ops/s $\color{#35bf28}+0.30\%$
test_a2c_speed[False-backward] 12.1844ms 11.6910ms 85.5361 Ops/s 84.5340 Ops/s $\color{#35bf28}+1.19\%$
test_a2c_speed[True-None] 4.0199ms 3.6666ms 272.7356 Ops/s 262.8247 Ops/s $\color{#35bf28}+3.77\%$
test_a2c_speed[True-backward] 8.8124ms 8.5123ms 117.4771 Ops/s 108.5081 Ops/s $\textbf{\color{#35bf28}+8.27\%}$
test_a2c_speed[reduce-overhead-None] 4.1051ms 3.6855ms 271.3335 Ops/s 270.9771 Ops/s $\color{#35bf28}+0.13\%$
test_a2c_speed[reduce-overhead-backward] 9.0725ms 8.6378ms 115.7706 Ops/s 110.4434 Ops/s $\color{#35bf28}+4.82\%$
test_ppo_speed[False-None] 6.2350ms 5.8663ms 170.4645 Ops/s 166.8050 Ops/s $\color{#35bf28}+2.19\%$
test_ppo_speed[False-backward] 12.8100ms 12.4663ms 80.2163 Ops/s 79.5559 Ops/s $\color{#35bf28}+0.83\%$
test_ppo_speed[True-None] 3.9698ms 3.6108ms 276.9463 Ops/s 270.8929 Ops/s $\color{#35bf28}+2.23\%$
test_ppo_speed[True-backward] 8.6261ms 8.4039ms 118.9929 Ops/s 118.8050 Ops/s $\color{#35bf28}+0.16\%$
test_ppo_speed[reduce-overhead-None] 3.9222ms 3.5474ms 281.8943 Ops/s 278.8988 Ops/s $\color{#35bf28}+1.07\%$
test_ppo_speed[reduce-overhead-backward] 9.1041ms 8.6474ms 115.6411 Ops/s 115.0126 Ops/s $\color{#35bf28}+0.55\%$
test_reinforce_speed[False-None] 4.7639ms 4.5126ms 221.6005 Ops/s 222.3286 Ops/s $\color{#d91a1a}-0.33\%$
test_reinforce_speed[False-backward] 7.5467ms 7.3043ms 136.9049 Ops/s 136.4021 Ops/s $\color{#35bf28}+0.37\%$
test_reinforce_speed[True-None] 3.2177ms 2.8583ms 349.8549 Ops/s 344.9067 Ops/s $\color{#35bf28}+1.43\%$
test_reinforce_speed[True-backward] 7.7961ms 7.6337ms 130.9983 Ops/s 130.6575 Ops/s $\color{#35bf28}+0.26\%$
test_reinforce_speed[reduce-overhead-None] 3.1393ms 2.8382ms 352.3362 Ops/s 350.5541 Ops/s $\color{#35bf28}+0.51\%$
test_reinforce_speed[reduce-overhead-backward] 8.0739ms 7.7674ms 128.7432 Ops/s 126.1218 Ops/s $\color{#35bf28}+2.08\%$
test_iql_speed[False-None] 24.4887ms 19.9541ms 50.1151 Ops/s 49.5148 Ops/s $\color{#35bf28}+1.21\%$
test_iql_speed[False-backward] 35.0240ms 30.3764ms 32.9203 Ops/s 32.8836 Ops/s $\color{#35bf28}+0.11\%$
test_iql_speed[True-None] 8.9374ms 8.4397ms 118.4882 Ops/s 115.2552 Ops/s $\color{#35bf28}+2.81\%$
test_iql_speed[True-backward] 17.0819ms 16.5928ms 60.2673 Ops/s 60.8766 Ops/s $\color{#d91a1a}-1.00\%$
test_iql_speed[reduce-overhead-None] 8.8914ms 8.5120ms 117.4815 Ops/s 118.9900 Ops/s $\color{#d91a1a}-1.27\%$
test_iql_speed[reduce-overhead-backward] 17.6603ms 17.0585ms 58.6219 Ops/s 58.3037 Ops/s $\color{#35bf28}+0.55\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 8.1509ms 6.1431ms 162.7833 Ops/s 162.3998 Ops/s $\color{#35bf28}+0.24\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6914ms 0.3740ms 2.6737 KOps/s 3.2323 KOps/s $\textbf{\color{#d91a1a}-17.28\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7330ms 0.3276ms 3.0522 KOps/s 3.3253 KOps/s $\textbf{\color{#d91a1a}-8.21\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1006ms 5.8468ms 171.0342 Ops/s 171.0934 Ops/s $\color{#d91a1a}-0.03\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1799ms 0.3668ms 2.7263 KOps/s 2.9647 KOps/s $\textbf{\color{#d91a1a}-8.04\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5631ms 0.3009ms 3.3236 KOps/s 3.0689 KOps/s $\textbf{\color{#35bf28}+8.30\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.8415ms 1.4249ms 701.8006 Ops/s 716.7062 Ops/s $\color{#d91a1a}-2.08\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6599ms 1.3495ms 740.9981 Ops/s 781.1872 Ops/s $\textbf{\color{#d91a1a}-5.14\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 9.9141ms 6.1401ms 162.8629 Ops/s 167.9292 Ops/s $\color{#d91a1a}-3.02\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.9618ms 0.4456ms 2.2441 KOps/s 938.0756 Ops/s $\textbf{\color{#35bf28}+139.23\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6754ms 0.4511ms 2.2169 KOps/s 2.2002 KOps/s $\color{#35bf28}+0.76\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.8734ms 5.7753ms 173.1521 Ops/s 168.0530 Ops/s $\color{#35bf28}+3.03\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.8140ms 0.3450ms 2.8989 KOps/s 3.1467 KOps/s $\textbf{\color{#d91a1a}-7.87\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.5127ms 0.3243ms 3.0831 KOps/s 3.2959 KOps/s $\textbf{\color{#d91a1a}-6.46\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1906ms 5.7161ms 174.9451 Ops/s 170.7904 Ops/s $\color{#35bf28}+2.43\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 0.6106ms 0.3037ms 3.2931 KOps/s 3.2170 KOps/s $\color{#35bf28}+2.37\%$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5632ms 0.3152ms 3.1730 KOps/s 3.2627 KOps/s $\color{#d91a1a}-2.75\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.1217ms 5.9679ms 167.5630 Ops/s 165.9450 Ops/s $\color{#35bf28}+0.98\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.5172ms 0.4717ms 2.1201 KOps/s 2.0942 KOps/s $\color{#35bf28}+1.24\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6146ms 0.4419ms 2.2629 KOps/s 2.0602 KOps/s $\textbf{\color{#35bf28}+9.84\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.4494ms 4.9619ms 201.5362 Ops/s 194.5908 Ops/s $\color{#35bf28}+3.57\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 7.5781ms 2.3105ms 432.7979 Ops/s 426.5127 Ops/s $\color{#35bf28}+1.47\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 8.2475ms 1.2316ms 811.9257 Ops/s 911.9069 Ops/s $\textbf{\color{#d91a1a}-10.96\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 7.9897ms 5.0412ms 198.3671 Ops/s 52.8471 Ops/s $\textbf{\color{#35bf28}+275.36\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 8.5738ms 2.3668ms 422.5069 Ops/s 641.1567 Ops/s $\textbf{\color{#d91a1a}-34.10\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 0.6123s 13.3870ms 74.6994 Ops/s 734.6985 Ops/s $\textbf{\color{#d91a1a}-89.83\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 7.7999ms 5.2425ms 190.7470 Ops/s 188.5514 Ops/s $\color{#35bf28}+1.16\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 10.5817ms 2.2095ms 452.5895 Ops/s 429.2269 Ops/s $\textbf{\color{#35bf28}+5.44\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.3536ms 1.3573ms 736.7423 Ops/s 686.6767 Ops/s $\textbf{\color{#35bf28}+7.29\%}$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 35.8745ms 33.6844ms 29.6873 Ops/s 29.0722 Ops/s $\color{#35bf28}+2.12\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.0377ms 17.6047ms 56.8030 Ops/s 56.2302 Ops/s $\color{#35bf28}+1.02\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 37.0089ms 34.7403ms 28.7850 Ops/s 28.4045 Ops/s $\color{#35bf28}+1.34\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.9526ms 17.9890ms 55.5894 Ops/s 55.9082 Ops/s $\color{#d91a1a}-0.57\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 42.2036ms 36.6725ms 27.2684 Ops/s 26.9457 Ops/s $\color{#35bf28}+1.20\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.4944ms 19.2779ms 51.8729 Ops/s 51.5592 Ops/s $\color{#35bf28}+0.61\%$

@vmoens
Update
de9de8d 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 31, 2025
@vmoens
[Test] Use spawn in older pytorch
9aac673 
ghstack-source-id: 3290165
Pull-Request: #3285
@vmoens vmoens added Tests Incomplete or broken unit tests bug Something isn't working labels Dec 31, 2025
@vmoens
Update
535fdc3 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Dec 31, 2025
Open
@vmoens
Update
934fdc0 
[ghstack-poisoned]
@vmoens
Update
633b83c 
[ghstack-poisoned]
@vmoens
Update
a05f1c4 
[ghstack-poisoned]
@vmoens vmoens mentioned this pull request Jan 1, 2026
Closed
vmoens added a commit that referenced this pull request Jan 1, 2026
@vmoens
[Test] Use spawn in older pytorch
9b04929 
ghstack-source-id: 0800d3e
Pull-Request: #3285
@vmoens vmoens merged commit a05f1c4 into gh/vmoens/171/base Jan 1, 2026
52 of 74 checks passed
@vmoens vmoens deleted the gh/vmoens/171/head branch January 1, 2026 07:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

bug Something isn't working CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Tests Incomplete or broken unit tests

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens