Skip to content

[CI] Fix SOTA runs #3252

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
vmoens merged 45 commits into from
Dec 18, 2025
Merged

[CI] Fix SOTA runs #3252

vmoens merged 45 commits into from
Dec 18, 2025

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Dec 12, 2025 •
edited
Loading

@vmoens
Update
b72e6ed 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
7572800 
ghstack-source-id: bc4da0d
Pull-Request: #3252
@pytorch-bot
Copy link

pytorch-bot bot commented Dec 12, 2025 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3252

Note: Links to docs will display an error until the docs builds have been completed.

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@vmoens vmoens mentioned this pull request Dec 12, 2025
Merged
@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Dec 12, 2025
@vmoens
Update
2aa2f9c 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
7abb1b9 
ghstack-source-id: 425e5d7
Pull-Request: #3252
@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Dec 12, 2025
@github-actions
Copy link

github-actions bot commented Dec 12, 2025 •
edited
Loading

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}12$. Worsened: $\large\color{#d91a1a}15$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 86.9147μs 85.8002μs 11.6550 KOps/s 11.5841 KOps/s $\color{#35bf28}+0.61\%$
test_tensor_to_bytestream_speed[torch.save] 0.1484ms 0.1476ms 6.7731 KOps/s 7.0920 KOps/s $\color{#d91a1a}-4.50\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1218s 0.1217s 8.2194 Ops/s 7.9944 Ops/s $\color{#35bf28}+2.81\%$
test_tensor_to_bytestream_speed[numpy] 2.6695μs 2.6654μs 375.1794 KOps/s 379.8951 KOps/s $\color{#d91a1a}-1.24\%$
test_tensor_to_bytestream_speed[safetensors] 37.8760μs 37.4614μs 26.6942 KOps/s 25.5203 KOps/s $\color{#35bf28}+4.60\%$
test_simple 0.5537s 0.5531s 1.8080 Ops/s 1.7392 Ops/s $\color{#35bf28}+3.96\%$
test_transformed 1.1238s 1.1233s 0.8902 Ops/s 0.8681 Ops/s $\color{#35bf28}+2.55\%$
test_serial 1.7293s 1.7041s 0.5868 Ops/s 0.5934 Ops/s $\color{#d91a1a}-1.12\%$
test_parallel 1.2403s 1.1435s 0.8745 Ops/s 0.8564 Ops/s $\color{#35bf28}+2.11\%$
test_step_mdp_speed[True-True-True-True-True] 0.2609ms 45.2421μs 22.1033 KOps/s 22.3037 KOps/s $\color{#d91a1a}-0.90\%$
test_step_mdp_speed[True-True-True-True-False] 67.7710μs 24.9882μs 40.0189 KOps/s 38.9149 KOps/s $\color{#35bf28}+2.84\%$
test_step_mdp_speed[True-True-True-False-True] 88.7620μs 25.4623μs 39.2737 KOps/s 39.2055 KOps/s $\color{#35bf28}+0.17\%$
test_step_mdp_speed[True-True-True-False-False] 41.4110μs 14.1716μs 70.5635 KOps/s 70.2533 KOps/s $\color{#35bf28}+0.44\%$
test_step_mdp_speed[True-True-False-True-True] 73.9310μs 47.8400μs 20.9030 KOps/s 20.5618 KOps/s $\color{#35bf28}+1.66\%$
test_step_mdp_speed[True-True-False-True-False] 58.4010μs 27.9232μs 35.8125 KOps/s 35.4261 KOps/s $\color{#35bf28}+1.09\%$
test_step_mdp_speed[True-True-False-False-True] 54.2110μs 28.1022μs 35.5844 KOps/s 35.1463 KOps/s $\color{#35bf28}+1.25\%$
test_step_mdp_speed[True-True-False-False-False] 45.7700μs 16.7924μs 59.5507 KOps/s 59.1112 KOps/s $\color{#35bf28}+0.74\%$
test_step_mdp_speed[True-False-True-True-True] 0.1230ms 50.8406μs 19.6693 KOps/s 19.4243 KOps/s $\color{#35bf28}+1.26\%$
test_step_mdp_speed[True-False-True-True-False] 57.6310μs 30.7274μs 32.5442 KOps/s 32.1830 KOps/s $\color{#35bf28}+1.12\%$
test_step_mdp_speed[True-False-True-False-True] 83.3920μs 28.7808μs 34.7454 KOps/s 35.2024 KOps/s $\color{#d91a1a}-1.30\%$
test_step_mdp_speed[True-False-True-False-False] 49.7510μs 16.8733μs 59.2651 KOps/s 59.3290 KOps/s $\color{#d91a1a}-0.11\%$
test_step_mdp_speed[True-False-False-True-True] 82.8020μs 52.8907μs 18.9069 KOps/s 18.9936 KOps/s $\color{#d91a1a}-0.46\%$
test_step_mdp_speed[True-False-False-True-False] 73.4610μs 32.9567μs 30.3428 KOps/s 29.6424 KOps/s $\color{#35bf28}+2.36\%$
test_step_mdp_speed[True-False-False-False-True] 57.3920μs 30.5740μs 32.7076 KOps/s 32.4385 KOps/s $\color{#35bf28}+0.83\%$
test_step_mdp_speed[True-False-False-False-False] 46.8010μs 19.3159μs 51.7707 KOps/s 50.4562 KOps/s $\color{#35bf28}+2.61\%$
test_step_mdp_speed[False-True-True-True-True] 80.1920μs 50.8650μs 19.6599 KOps/s 19.4649 KOps/s $\color{#35bf28}+1.00\%$
test_step_mdp_speed[False-True-True-True-False] 60.5410μs 30.0906μs 33.2330 KOps/s 32.1792 KOps/s $\color{#35bf28}+3.27\%$
test_step_mdp_speed[False-True-True-False-True] 2.3943ms 32.2920μs 30.9674 KOps/s 30.9314 KOps/s $\color{#35bf28}+0.12\%$
test_step_mdp_speed[False-True-True-False-False] 47.1200μs 18.3610μs 54.4634 KOps/s 53.6607 KOps/s $\color{#35bf28}+1.50\%$
test_step_mdp_speed[False-True-False-True-True] 0.1058ms 52.8503μs 18.9214 KOps/s 18.6280 KOps/s $\color{#35bf28}+1.57\%$
test_step_mdp_speed[False-True-False-True-False] 59.7410μs 32.7625μs 30.5227 KOps/s 29.3276 KOps/s $\color{#35bf28}+4.08\%$
test_step_mdp_speed[False-True-False-False-True] 64.5410μs 34.3010μs 29.1536 KOps/s 28.9922 KOps/s $\color{#35bf28}+0.56\%$
test_step_mdp_speed[False-True-False-False-False] 50.8810μs 20.6588μs 48.4055 KOps/s 47.1443 KOps/s $\color{#35bf28}+2.68\%$
test_step_mdp_speed[False-False-True-True-True] 85.4220μs 55.4384μs 18.0380 KOps/s 18.0685 KOps/s $\color{#d91a1a}-0.17\%$
test_step_mdp_speed[False-False-True-True-False] 65.8710μs 35.9299μs 27.8320 KOps/s 27.2312 KOps/s $\color{#35bf28}+2.21\%$
test_step_mdp_speed[False-False-True-False-True] 68.0610μs 34.1579μs 29.2758 KOps/s 29.4402 KOps/s $\color{#d91a1a}-0.56\%$
test_step_mdp_speed[False-False-True-False-False] 47.8810μs 20.8769μs 47.8998 KOps/s 46.7065 KOps/s $\color{#35bf28}+2.55\%$
test_step_mdp_speed[False-False-False-True-True] 94.2820μs 57.9187μs 17.2656 KOps/s 17.3512 KOps/s $\color{#d91a1a}-0.49\%$
test_step_mdp_speed[False-False-False-True-False] 84.7720μs 38.3660μs 26.0647 KOps/s 25.5093 KOps/s $\color{#35bf28}+2.18\%$
test_step_mdp_speed[False-False-False-False-True] 70.5710μs 36.4615μs 27.4262 KOps/s 27.1583 KOps/s $\color{#35bf28}+0.99\%$
test_step_mdp_speed[False-False-False-False-False] 53.8410μs 23.2891μs 42.9385 KOps/s 42.2059 KOps/s $\color{#35bf28}+1.74\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.8840s 0.7816s 1.2794 Ops/s 1.2751 Ops/s $\color{#35bf28}+0.34\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7460s 0.6409s 1.5602 Ops/s 1.5553 Ops/s $\color{#35bf28}+0.32\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7789s 1.6959s 0.5897 Ops/s 0.5897 Ops/s $-0.00\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5467s 1.4616s 0.6842 Ops/s 0.6754 Ops/s $\color{#35bf28}+1.30\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 2.0110s 1.9336s 0.5172 Ops/s 0.5143 Ops/s $\color{#35bf28}+0.56\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.8007s 1.7208s 0.5811 Ops/s 0.5790 Ops/s $\color{#35bf28}+0.37\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.7009s 4.6150s 0.2167 Ops/s 0.2166 Ops/s $\color{#35bf28}+0.03\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.4643s 4.4210s 0.2262 Ops/s 0.2238 Ops/s $\color{#35bf28}+1.05\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 2.0325s 1.9517s 0.5124 Ops/s 0.5050 Ops/s $\color{#35bf28}+1.47\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7797s 1.6880s 0.5924 Ops/s 0.5915 Ops/s $\color{#35bf28}+0.15\%$
test_values[generalized_advantage_estimate-True-True] 11.0758ms 10.4352ms 95.8296 Ops/s 96.2548 Ops/s $\color{#d91a1a}-0.44\%$
test_values[vec_generalized_advantage_estimate-True-True] 15.2544ms 11.2294ms 89.0518 Ops/s 56.0620 Ops/s $\textbf{\color{#35bf28}+58.85\%}$
test_values[td0_return_estimate-False-False] 0.2175ms 0.1333ms 7.5042 KOps/s 7.9958 KOps/s $\textbf{\color{#d91a1a}-6.15\%}$
test_values[td1_return_estimate-False-False] 28.3500ms 27.9916ms 35.7250 Ops/s 35.9426 Ops/s $\color{#d91a1a}-0.61\%$
test_values[vec_td1_return_estimate-False-False] 11.8993ms 11.2871ms 88.5964 Ops/s 55.4381 Ops/s $\textbf{\color{#35bf28}+59.81\%}$
test_values[td_lambda_return_estimate-True-False] 42.1712ms 41.3301ms 24.1955 Ops/s 24.3301 Ops/s $\color{#d91a1a}-0.55\%$
test_values[vec_td_lambda_return_estimate-True-False] 13.1553ms 11.2558ms 88.8431 Ops/s 55.4188 Ops/s $\textbf{\color{#35bf28}+60.31\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512] 9.3514ms 9.1680ms 109.0747 Ops/s 106.5285 Ops/s $\color{#35bf28}+2.39\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.7095ms 1.5058ms 664.1148 Ops/s 642.5561 Ops/s $\color{#35bf28}+3.36\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8101ms 0.4256ms 2.3497 KOps/s 2.4079 KOps/s $\color{#d91a1a}-2.42\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 34.9707ms 29.7267ms 33.6398 Ops/s 30.7004 Ops/s $\textbf{\color{#35bf28}+9.57\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 2.0833ms 1.7123ms 583.9948 Ops/s 582.6179 Ops/s $\color{#35bf28}+0.24\%$
test_dqn_speed[False-None] 1.5906ms 1.4201ms 704.1810 Ops/s 706.6068 Ops/s $\color{#d91a1a}-0.34\%$
test_dqn_speed[False-backward] 2.1487ms 1.9252ms 519.4195 Ops/s 517.4050 Ops/s $\color{#35bf28}+0.39\%$
test_dqn_speed[True-None] 0.6977ms 0.5416ms 1.8465 KOps/s 1.8397 KOps/s $\color{#35bf28}+0.37\%$
test_dqn_speed[True-backward] 1.0245ms 0.9915ms 1.0085 KOps/s 1.0042 KOps/s $\color{#35bf28}+0.43\%$
test_dqn_speed[reduce-overhead-None] 0.9397ms 0.5306ms 1.8847 KOps/s 1.8860 KOps/s $\color{#d91a1a}-0.07\%$
test_dqn_speed[reduce-overhead-backward] 1.0439ms 0.9809ms 1.0195 KOps/s 1.0250 KOps/s $\color{#d91a1a}-0.54\%$
test_ddpg_speed[False-None] 3.5696ms 2.8884ms 346.2078 Ops/s 348.2132 Ops/s $\color{#d91a1a}-0.58\%$
test_ddpg_speed[False-backward] 4.2080ms 4.1118ms 243.2038 Ops/s 243.5551 Ops/s $\color{#d91a1a}-0.14\%$
test_ddpg_speed[True-None] 1.8174ms 1.4074ms 710.5322 Ops/s 703.1578 Ops/s $\color{#35bf28}+1.05\%$
test_ddpg_speed[True-backward] 2.7976ms 2.4007ms 416.5400 Ops/s 348.1527 Ops/s $\textbf{\color{#35bf28}+19.64\%}$
test_ddpg_speed[reduce-overhead-None] 1.7939ms 1.3939ms 717.3952 Ops/s 710.3758 Ops/s $\color{#35bf28}+0.99\%$
test_ddpg_speed[reduce-overhead-backward] 2.7794ms 2.3703ms 421.8963 Ops/s 381.2470 Ops/s $\textbf{\color{#35bf28}+10.66\%}$
test_sac_speed[False-None] 9.4838ms 8.0871ms 123.6542 Ops/s 124.9080 Ops/s $\color{#d91a1a}-1.00\%$
test_sac_speed[False-backward] 11.5722ms 11.3507ms 88.1002 Ops/s 88.8000 Ops/s $\color{#d91a1a}-0.79\%$
test_sac_speed[True-None] 2.5240ms 2.1465ms 465.8744 Ops/s 461.0736 Ops/s $\color{#35bf28}+1.04\%$
test_sac_speed[True-backward] 4.8485ms 4.2160ms 237.1920 Ops/s 229.5642 Ops/s $\color{#35bf28}+3.32\%$
test_sac_speed[reduce-overhead-None] 2.2935ms 2.1759ms 459.5716 Ops/s 460.9251 Ops/s $\color{#d91a1a}-0.29\%$
test_sac_speed[reduce-overhead-backward] 4.2428ms 4.1060ms 243.5474 Ops/s 238.6839 Ops/s $\color{#35bf28}+2.04\%$
test_redq_speed[False-None] 12.9227ms 10.6673ms 93.7443 Ops/s 96.7482 Ops/s $\color{#d91a1a}-3.10\%$
test_redq_speed[False-backward] 18.7744ms 18.2353ms 54.8386 Ops/s 55.6747 Ops/s $\color{#d91a1a}-1.50\%$
test_redq_speed[True-None] 4.9609ms 4.5378ms 220.3693 Ops/s 209.0079 Ops/s $\textbf{\color{#35bf28}+5.44\%}$
test_redq_speed[True-backward] 10.3176ms 9.8869ms 101.1440 Ops/s 101.6582 Ops/s $\color{#d91a1a}-0.51\%$
test_redq_speed[reduce-overhead-None] 4.6186ms 4.4664ms 223.8945 Ops/s 228.6607 Ops/s $\color{#d91a1a}-2.08\%$
test_redq_speed[reduce-overhead-backward] 10.5003ms 10.2030ms 98.0102 Ops/s 101.0307 Ops/s $\color{#d91a1a}-2.99\%$
test_redq_deprec_speed[False-None] 13.7410ms 11.2470ms 88.9124 Ops/s 91.1458 Ops/s $\color{#d91a1a}-2.45\%$
test_redq_deprec_speed[False-backward] 16.4196ms 16.0680ms 62.2356 Ops/s 64.1684 Ops/s $\color{#d91a1a}-3.01\%$
test_redq_deprec_speed[True-None] 4.2023ms 3.7821ms 264.4064 Ops/s 265.9889 Ops/s $\color{#d91a1a}-0.59\%$
test_redq_deprec_speed[True-backward] 8.0105ms 7.7788ms 128.5551 Ops/s 128.3043 Ops/s $\color{#35bf28}+0.20\%$
test_redq_deprec_speed[reduce-overhead-None] 4.2608ms 3.7570ms 266.1717 Ops/s 274.0566 Ops/s $\color{#d91a1a}-2.88\%$
test_redq_deprec_speed[reduce-overhead-backward] 8.0952ms 7.8667ms 127.1181 Ops/s 132.4564 Ops/s $\color{#d91a1a}-4.03\%$
test_td3_speed[False-None] 8.3324ms 8.1392ms 122.8626 Ops/s 124.1485 Ops/s $\color{#d91a1a}-1.04\%$
test_td3_speed[False-backward] 11.7096ms 11.0723ms 90.3158 Ops/s 89.9916 Ops/s $\color{#35bf28}+0.36\%$
test_td3_speed[True-None] 1.9182ms 1.8453ms 541.9119 Ops/s 525.5688 Ops/s $\color{#35bf28}+3.11\%$
test_td3_speed[True-backward] 3.8185ms 3.6970ms 270.4863 Ops/s 240.6801 Ops/s $\textbf{\color{#35bf28}+12.38\%}$
test_td3_speed[reduce-overhead-None] 1.8994ms 1.7946ms 557.2219 Ops/s 551.4520 Ops/s $\color{#35bf28}+1.05\%$
test_td3_speed[reduce-overhead-backward] 4.1478ms 3.6874ms 271.1906 Ops/s 274.3577 Ops/s $\color{#d91a1a}-1.15\%$
test_cql_speed[False-None] 29.1128ms 26.6046ms 37.5874 Ops/s 38.4526 Ops/s $\color{#d91a1a}-2.25\%$
test_cql_speed[False-backward] 39.1944ms 36.1948ms 27.6283 Ops/s 27.3154 Ops/s $\color{#35bf28}+1.15\%$
test_cql_speed[True-None] 13.1745ms 12.5067ms 79.9574 Ops/s 79.8664 Ops/s $\color{#35bf28}+0.11\%$
test_cql_speed[True-backward] 19.2693ms 18.6612ms 53.5871 Ops/s 53.2638 Ops/s $\color{#35bf28}+0.61\%$
test_cql_speed[reduce-overhead-None] 13.3387ms 12.6597ms 78.9907 Ops/s 80.1716 Ops/s $\color{#d91a1a}-1.47\%$
test_cql_speed[reduce-overhead-backward] 18.9254ms 18.5872ms 53.8003 Ops/s 55.2284 Ops/s $\color{#d91a1a}-2.59\%$
test_a2c_speed[False-None] 6.5314ms 5.5768ms 179.3147 Ops/s 177.3135 Ops/s $\color{#35bf28}+1.13\%$
test_a2c_speed[False-backward] 12.5043ms 12.2086ms 81.9093 Ops/s 81.1421 Ops/s $\color{#35bf28}+0.95\%$
test_a2c_speed[True-None] 4.1729ms 3.7377ms 267.5410 Ops/s 268.1081 Ops/s $\color{#d91a1a}-0.21\%$
test_a2c_speed[True-backward] 9.0765ms 8.7490ms 114.2989 Ops/s 115.5978 Ops/s $\color{#d91a1a}-1.12\%$
test_a2c_speed[reduce-overhead-None] 4.1563ms 3.7554ms 266.2812 Ops/s 267.9796 Ops/s $\color{#d91a1a}-0.63\%$
test_a2c_speed[reduce-overhead-backward] 9.4731ms 9.0156ms 110.9187 Ops/s 113.3542 Ops/s $\color{#d91a1a}-2.15\%$
test_ppo_speed[False-None] 6.6222ms 6.0440ms 165.4545 Ops/s 169.8522 Ops/s $\color{#d91a1a}-2.59\%$
test_ppo_speed[False-backward] 13.6394ms 12.9947ms 76.9546 Ops/s 78.6044 Ops/s $\color{#d91a1a}-2.10\%$
test_ppo_speed[True-None] 4.1713ms 3.7242ms 268.5122 Ops/s 270.1568 Ops/s $\color{#d91a1a}-0.61\%$
test_ppo_speed[True-backward] 8.9049ms 8.6712ms 115.3240 Ops/s 116.2057 Ops/s $\color{#d91a1a}-0.76\%$
test_ppo_speed[reduce-overhead-None] 4.0237ms 3.6166ms 276.5057 Ops/s 274.4054 Ops/s $\color{#35bf28}+0.77\%$
test_ppo_speed[reduce-overhead-backward] 9.1290ms 8.8916ms 112.4660 Ops/s 113.2149 Ops/s $\color{#d91a1a}-0.66\%$
test_reinforce_speed[False-None] 4.9698ms 4.6704ms 214.1152 Ops/s 211.4838 Ops/s $\color{#35bf28}+1.24\%$
test_reinforce_speed[False-backward] 7.9259ms 7.6204ms 131.2270 Ops/s 131.2626 Ops/s $\color{#d91a1a}-0.03\%$
test_reinforce_speed[True-None] 3.4913ms 2.9752ms 336.1115 Ops/s 328.8966 Ops/s $\color{#35bf28}+2.19\%$
test_reinforce_speed[True-backward] 8.0693ms 7.8790ms 126.9194 Ops/s 123.2788 Ops/s $\color{#35bf28}+2.95\%$
test_reinforce_speed[reduce-overhead-None] 3.1764ms 2.9407ms 340.0556 Ops/s 337.1296 Ops/s $\color{#35bf28}+0.87\%$
test_reinforce_speed[reduce-overhead-backward] 8.5073ms 8.1667ms 122.4492 Ops/s 123.4291 Ops/s $\color{#d91a1a}-0.79\%$
test_iql_speed[False-None] 25.5112ms 20.4997ms 48.7811 Ops/s 47.0783 Ops/s $\color{#35bf28}+3.62\%$
test_iql_speed[False-backward] 32.0116ms 31.2474ms 32.0027 Ops/s 31.6378 Ops/s $\color{#35bf28}+1.15\%$
test_iql_speed[True-None] 9.1141ms 8.7607ms 114.1465 Ops/s 114.2797 Ops/s $\color{#d91a1a}-0.12\%$
test_iql_speed[True-backward] 17.5574ms 17.0036ms 58.8110 Ops/s 58.7045 Ops/s $\color{#35bf28}+0.18\%$
test_iql_speed[reduce-overhead-None] 9.2885ms 8.7977ms 113.6655 Ops/s 110.9076 Ops/s $\color{#35bf28}+2.49\%$
test_iql_speed[reduce-overhead-backward] 18.1777ms 17.5527ms 56.9714 Ops/s 56.8210 Ops/s $\color{#35bf28}+0.26\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.2709ms 6.1064ms 163.7636 Ops/s 160.3390 Ops/s $\color{#35bf28}+2.14\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.9150ms 0.3878ms 2.5788 KOps/s 3.4657 KOps/s $\textbf{\color{#d91a1a}-25.59\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7014ms 0.3891ms 2.5701 KOps/s 3.3240 KOps/s $\textbf{\color{#d91a1a}-22.68\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0273ms 5.8008ms 172.3913 Ops/s 172.3643 Ops/s $\color{#35bf28}+0.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.6216ms 0.3652ms 2.7381 KOps/s 3.5331 KOps/s $\textbf{\color{#d91a1a}-22.50\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5749ms 0.3088ms 3.2378 KOps/s 3.8065 KOps/s $\textbf{\color{#d91a1a}-14.94\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.7669ms 1.4384ms 695.2376 Ops/s 778.2433 Ops/s $\textbf{\color{#d91a1a}-10.67\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.6195ms 1.3627ms 733.8432 Ops/s 829.2470 Ops/s $\textbf{\color{#d91a1a}-11.50\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.1084ms 5.9257ms 168.7558 Ops/s 169.8438 Ops/s $\color{#d91a1a}-0.64\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.4870ms 0.5217ms 1.9169 KOps/s 2.2346 KOps/s $\textbf{\color{#d91a1a}-14.22\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.9240ms 0.5050ms 1.9802 KOps/s 2.4187 KOps/s $\textbf{\color{#d91a1a}-18.13\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.1393ms 5.8419ms 171.1778 Ops/s 171.6350 Ops/s $\color{#d91a1a}-0.27\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.9154ms 0.3047ms 3.2822 KOps/s 3.4781 KOps/s $\textbf{\color{#d91a1a}-5.63\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.4826ms 0.2828ms 3.5364 KOps/s 3.7529 KOps/s $\textbf{\color{#d91a1a}-5.77\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.1428ms 5.8848ms 169.9304 Ops/s 167.8349 Ops/s $\color{#35bf28}+1.25\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.1110ms 0.3101ms 3.2248 KOps/s 2.9385 KOps/s $\textbf{\color{#35bf28}+9.74\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4931ms 0.3088ms 3.2386 KOps/s 3.0308 KOps/s $\textbf{\color{#35bf28}+6.86\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.1196ms 6.0213ms 166.0773 Ops/s 162.7982 Ops/s $\color{#35bf28}+2.01\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 0.8310ms 0.5115ms 1.9552 KOps/s 2.1687 KOps/s $\textbf{\color{#d91a1a}-9.84\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6886ms 0.4945ms 2.0224 KOps/s 2.2681 KOps/s $\textbf{\color{#d91a1a}-10.83\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 6.6924ms 5.2682ms 189.8191 Ops/s 195.8846 Ops/s $\color{#d91a1a}-3.10\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 9.8298ms 2.4887ms 401.8143 Ops/s 417.9380 Ops/s $\color{#d91a1a}-3.86\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 2.1270ms 1.0882ms 918.9243 Ops/s 806.0822 Ops/s $\textbf{\color{#35bf28}+14.00\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 0.6871s 19.0233ms 52.5672 Ops/s 187.6062 Ops/s $\textbf{\color{#d91a1a}-71.98\%}$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 3.0642ms 1.4638ms 683.1319 Ops/s 58.7153 Ops/s $\textbf{\color{#35bf28}+1063.47\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 11.6312ms 1.3039ms 766.9578 Ops/s 1.0330 KOps/s $\textbf{\color{#d91a1a}-25.76\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 7.6718ms 5.5860ms 179.0201 Ops/s 184.7576 Ops/s $\color{#d91a1a}-3.11\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 9.0995ms 2.2491ms 444.6241 Ops/s 442.4847 Ops/s $\color{#35bf28}+0.48\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 7.6085ms 1.3991ms 714.7581 Ops/s 711.7057 Ops/s $\color{#35bf28}+0.43\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 35.7842ms 33.4040ms 29.9365 Ops/s 29.0080 Ops/s $\color{#35bf28}+3.20\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.8175ms 17.6362ms 56.7017 Ops/s 55.7018 Ops/s $\color{#35bf28}+1.80\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 37.5262ms 34.3233ms 29.1347 Ops/s 28.8034 Ops/s $\color{#35bf28}+1.15\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.8651ms 17.7537ms 56.3262 Ops/s 54.6586 Ops/s $\color{#35bf28}+3.05\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 41.8029ms 36.4814ms 27.4112 Ops/s 26.9271 Ops/s $\color{#35bf28}+1.80\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 20.9732ms 19.4404ms 51.4394 Ops/s 49.2259 Ops/s $\color{#35bf28}+4.50\%$

@vmoens
Update
693f3e9 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
2626d9f 
ghstack-source-id: ff964bc
Pull-Request: #3252
@vmoens
Update
4bc19f9 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
f1f2810 
ghstack-source-id: f376edd
Pull-Request: #3252
@vmoens
Update
7f4124b 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
7da4045 
ghstack-source-id: 104a25c
Pull-Request: #3252
@vmoens
Update
051ebd6 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
d184079 
ghstack-source-id: f836089
Pull-Request: #3252
@vmoens
Update
34dec7a 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
a781e36 
ghstack-source-id: 243a90c
Pull-Request: #3252
@vmoens
Update
14a1f56 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
536dfa1 
ghstack-source-id: 53d072e
Pull-Request: #3252
@vmoens
Update
77b0337 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
3e1567b 
ghstack-source-id: f19d10d
Pull-Request: #3252
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
79b1a5f 
ghstack-source-id: f19d10d
Pull-Request: #3252
@vmoens
Update
3834732 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
80fa0dd 
ghstack-source-id: 4ffce66
Pull-Request: #3252
@vmoens
Update
85a0718 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
68c7d12 
ghstack-source-id: 3255b94
Pull-Request: #3252
@vmoens
Update
cb6d148 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 12, 2025
@vmoens
[CI] Fix SOTA runs
cb51271 
ghstack-source-id: 29be2b7
Pull-Request: #3252
@vmoens
Update
1944599 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 16, 2025
@vmoens
[CI] Fix SOTA runs
146d357 
ghstack-source-id: 8af9798
Pull-Request: #3252
@vmoens
Update
2c919f5 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 16, 2025
@vmoens
[CI] Fix SOTA runs
7b6dce5 
ghstack-source-id: 061a454
Pull-Request: #3252
@vmoens
Update
e34b474 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 16, 2025
@vmoens
[CI] Fix SOTA runs
8c73fe5 
ghstack-source-id: deb9bb1
Pull-Request: #3252
@vmoens
Update
0b82563 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 16, 2025
@vmoens
[CI] Fix SOTA runs
8636f88 
ghstack-source-id: 648cb5d
Pull-Request: #3252
@vmoens
Update
7189fb9 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 17, 2025
@vmoens
[CI] Fix SOTA runs
f603af9 
ghstack-source-id: 8454aa5
Pull-Request: #3252
@vmoens
Update
d51342a 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 17, 2025
@vmoens
[CI] Fix SOTA runs
ce63e5f 
ghstack-source-id: d361dac
Pull-Request: #3252
@vmoens
Update
ec96627 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 17, 2025
@vmoens
[CI] Fix SOTA runs
feb69a9 
ghstack-source-id: 987269e
Pull-Request: #3252
@vmoens
Update
e6dcb0d 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 17, 2025
@vmoens
[CI] Fix SOTA runs
35195f3 
ghstack-source-id: 01b920c
Pull-Request: #3252
@vmoens
Update
4c06a56 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 17, 2025
@vmoens
[CI] Fix SOTA runs
c3df38e 
ghstack-source-id: c77c19b
Pull-Request: #3252
@vmoens
Update
c643083 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 17, 2025
@vmoens
[CI] Fix SOTA runs
47f06a0 
ghstack-source-id: fa24b4c
Pull-Request: #3252
@vmoens
Update
fe8fdef 
[ghstack-poisoned]
This was referenced Dec 18, 2025
Merged
Merged
Merged
Merged
@vmoens
Update
3f3d7af 
[ghstack-poisoned]
@vmoens
Update
ad9e57a 
[ghstack-poisoned]
vmoens added a commit that referenced this pull request Dec 18, 2025
@vmoens
[CI] Fix SOTA runs
57000cf 
ghstack-source-id: 4651014
Pull-Request: #3252
@vmoens vmoens merged commit ad9e57a into gh/vmoens/169/base Dec 18, 2025
52 of 61 checks passed
@vmoens vmoens deleted the gh/vmoens/169/head branch December 18, 2025 11:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@vmoens