[Test] Add test for lambda wrapping in ParallelEnv

[vmoens]

Stack from ghstack (oldest at bottom):

• [Test] Use class references instead of lambdas in transform tests #3279
• -> [Test] Add test for lambda wrapping in ParallelEnv #3278
• [Feature] Auto-wrap lambda functions with EnvCreator for spawn compatibility #3277
• [Test] Ensure collector shutdown with try/finally #3276
• [Test] Add filterwarnings for unclosed resources #3275
• [Test] Add retry decorator to flaky vecnorm test #3274
• [Test] Simplify num_threads test to check threads in env factory #3273
• [Refactor] Move decorate_thread_sub_func to torchrl.testing.mp_helpers #3272
• [BugFix] Handle Lock/RLock types in EnvCreator #3271
• [BugFix] Defer filter_warnings import to avoid module load issues #3270
• [BugFix] Fix CUDA sync in forked subprocess #3269
• [CI] Add --upgrade flag for torch installs and install ffmpeg/xvfb #3268

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3278

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

• B200 runners are down due to network issues

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[github-actions]

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of CPU Benchmark Tests

Total Benchmarks: 164. Improved: $\large\color{#35bf28}22$. Worsened: $\large\color{#d91a1a}3$.

Expand to view detailed results

Name	Max	Mean	Ops	Ops on Repo HEAD	Change
test_tensor_to_bytestream_speed[pickle]	81.7532μs	81.0863μs	12.3325 KOps/s	12.3197 KOps/s	$\color{#35bf28}+0.10\%$
test_tensor_to_bytestream_speed[torch.save]	0.1413ms	0.1409ms	7.0977 KOps/s	7.1365 KOps/s	$\color{#d91a1a}-0.54\%$
test_tensor_to_bytestream_speed[untyped_storage]	0.1193s	0.1186s	8.4336 Ops/s	8.1216 Ops/s	$\color{#35bf28}+3.84\%$
test_tensor_to_bytestream_speed[numpy]	2.6943μs	2.6859μs	372.3087 KOps/s	373.5142 KOps/s	$\color{#d91a1a}-0.32\%$
test_tensor_to_bytestream_speed[safetensors]	41.1930μs	39.8794μs	25.0756 KOps/s	25.5490 KOps/s	$\color{#d91a1a}-1.85\%$
test_simple	0.5615s	0.5609s	1.7827 Ops/s	1.7155 Ops/s	$\color{#35bf28}+3.92\%$
test_transformed	1.1518s	1.1488s	0.8704 Ops/s	0.8628 Ops/s	$\color{#35bf28}+0.88\%$
test_serial	1.7243s	1.7155s	0.5829 Ops/s	0.5839 Ops/s	$\color{#d91a1a}-0.17\%$
test_parallel	1.2819s	1.1905s	0.8400 Ops/s	0.8786 Ops/s	$\color{#d91a1a}-4.39\%$
test_step_mdp_speed[True-True-True-True-True]	0.1321ms	43.8961μs	22.7811 KOps/s	22.2008 KOps/s	$\color{#35bf28}+2.61\%$
test_step_mdp_speed[True-True-True-True-False]	47.8610μs	25.3616μs	39.4298 KOps/s	39.2517 KOps/s	$\color{#35bf28}+0.45\%$
test_step_mdp_speed[True-True-True-False-True]	63.1010μs	25.1914μs	39.6960 KOps/s	39.3781 KOps/s	$\color{#35bf28}+0.81\%$
test_step_mdp_speed[True-True-True-False-False]	39.6410μs	13.9097μs	71.8922 KOps/s	71.1818 KOps/s	$\color{#35bf28}+1.00\%$
test_step_mdp_speed[True-True-False-True-True]	76.9220μs	48.7018μs	20.5331 KOps/s	20.3861 KOps/s	$\color{#35bf28}+0.72\%$
test_step_mdp_speed[True-True-False-True-False]	56.9310μs	27.8905μs	35.8545 KOps/s	35.4091 KOps/s	$\color{#35bf28}+1.26\%$
test_step_mdp_speed[True-True-False-False-True]	59.6710μs	28.5727μs	34.9984 KOps/s	34.5534 KOps/s	$\color{#35bf28}+1.29\%$
test_step_mdp_speed[True-True-False-False-False]	42.5910μs	16.6215μs	60.1630 KOps/s	59.7548 KOps/s	$\color{#35bf28}+0.68\%$
test_step_mdp_speed[True-False-True-True-True]	81.0320μs	51.8826μs	19.2743 KOps/s	19.1991 KOps/s	$\color{#35bf28}+0.39\%$
test_step_mdp_speed[True-False-True-True-False]	67.0110μs	30.8309μs	32.4350 KOps/s	32.3722 KOps/s	$\color{#35bf28}+0.19\%$
test_step_mdp_speed[True-False-True-False-True]	62.8710μs	28.1140μs	35.5695 KOps/s	35.4051 KOps/s	$\color{#35bf28}+0.46\%$
test_step_mdp_speed[True-False-True-False-False]	46.7010μs	16.7634μs	59.6536 KOps/s	59.1170 KOps/s	$\color{#35bf28}+0.91\%$
test_step_mdp_speed[True-False-False-True-True]	97.9420μs	53.4431μs	18.7115 KOps/s	18.4038 KOps/s	$\color{#35bf28}+1.67\%$
test_step_mdp_speed[True-False-False-True-False]	70.5520μs	33.1457μs	30.1698 KOps/s	29.7632 KOps/s	$\color{#35bf28}+1.37\%$
test_step_mdp_speed[True-False-False-False-True]	68.1510μs	30.8160μs	32.4507 KOps/s	32.3414 KOps/s	$\color{#35bf28}+0.34\%$
test_step_mdp_speed[True-False-False-False-False]	50.1610μs	19.1656μs	52.1769 KOps/s	51.3854 KOps/s	$\color{#35bf28}+1.54\%$
test_step_mdp_speed[False-True-True-True-True]	91.7220μs	51.0728μs	19.5799 KOps/s	19.4200 KOps/s	$\color{#35bf28}+0.82\%$
test_step_mdp_speed[False-True-True-True-False]	61.9210μs	30.6022μs	32.6774 KOps/s	31.8580 KOps/s	$\color{#35bf28}+2.57\%$
test_step_mdp_speed[False-True-True-False-True]	2.1733ms	32.2621μs	30.9961 KOps/s	31.2678 KOps/s	$\color{#d91a1a}-0.87\%$
test_step_mdp_speed[False-True-True-False-False]	47.2910μs	18.3435μs	54.5152 KOps/s	53.3566 KOps/s	$\color{#35bf28}+2.17\%$
test_step_mdp_speed[False-True-False-True-True]	89.2120μs	53.9260μs	18.5439 KOps/s	18.4148 KOps/s	$\color{#35bf28}+0.70\%$
test_step_mdp_speed[False-True-False-True-False]	60.0920μs	33.6559μs	29.7125 KOps/s	29.6205 KOps/s	$\color{#35bf28}+0.31\%$
test_step_mdp_speed[False-True-False-False-True]	64.1720μs	34.4942μs	28.9904 KOps/s	29.0115 KOps/s	$\color{#d91a1a}-0.07\%$
test_step_mdp_speed[False-True-False-False-False]	51.5410μs	20.9374μs	47.7613 KOps/s	47.1277 KOps/s	$\color{#35bf28}+1.34\%$
test_step_mdp_speed[False-False-True-True-True]	93.1620μs	56.7865μs	17.6098 KOps/s	17.4609 KOps/s	$\color{#35bf28}+0.85\%$
test_step_mdp_speed[False-False-True-True-False]	63.9710μs	36.0091μs	27.7708 KOps/s	27.3486 KOps/s	$\color{#35bf28}+1.54\%$
test_step_mdp_speed[False-False-True-False-True]	64.3710μs	33.7996μs	29.5862 KOps/s	29.2041 KOps/s	$\color{#35bf28}+1.31\%$
test_step_mdp_speed[False-False-True-False-False]	53.4110μs	21.0177μs	47.5788 KOps/s	46.6076 KOps/s	$\color{#35bf28}+2.08\%$
test_step_mdp_speed[False-False-False-True-True]	97.0420μs	58.9978μs	16.9498 KOps/s	16.9501 KOps/s	$-0.00\%$
test_step_mdp_speed[False-False-False-True-False]	67.6010μs	38.3275μs	26.0909 KOps/s	25.9258 KOps/s	$\color{#35bf28}+0.64\%$
test_step_mdp_speed[False-False-False-False-True]	65.2510μs	36.7715μs	27.1950 KOps/s	26.9905 KOps/s	$\color{#35bf28}+0.76\%$
test_step_mdp_speed[False-False-False-False-False]	49.8910μs	23.5365μs	42.4872 KOps/s	41.7828 KOps/s	$\color{#35bf28}+1.69\%$
test_non_tensor_env_rollout_speed[1000-single-True]	0.9145s	0.8203s	1.2191 Ops/s	1.2678 Ops/s	$\color{#d91a1a}-3.84\%$
test_non_tensor_env_rollout_speed[1000-single-False]	0.7744s	0.6674s	1.4983 Ops/s	1.5304 Ops/s	$\color{#d91a1a}-2.10\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True]	1.8678s	1.7944s	0.5573 Ops/s	0.5834 Ops/s	$\color{#d91a1a}-4.47\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False]	1.6059s	1.5128s	0.6610 Ops/s	0.6719 Ops/s	$\color{#d91a1a}-1.63\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True]	2.0562s	1.9946s	0.5014 Ops/s	0.5099 Ops/s	$\color{#d91a1a}-1.68\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False]	1.8586s	1.7628s	0.5673 Ops/s	0.5765 Ops/s	$\color{#d91a1a}-1.59\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True]	4.9531s	4.7724s	0.2095 Ops/s	0.2093 Ops/s	$\color{#35bf28}+0.11\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False]	4.6375s	4.5436s	0.2201 Ops/s	0.2201 Ops/s	$\color{#d91a1a}-0.01\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True]	2.1250s	2.0289s	0.4929 Ops/s	0.4996 Ops/s	$\color{#d91a1a}-1.34\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False]	1.7780s	1.7046s	0.5866 Ops/s	0.5856 Ops/s	$\color{#35bf28}+0.17\%$
test_values[generalized_advantage_estimate-True-True]	10.5041ms	10.3310ms	96.7962 Ops/s	95.9619 Ops/s	$\color{#35bf28}+0.87\%$
test_values[vec_generalized_advantage_estimate-True-True]	13.2438ms	11.4555ms	87.2945 Ops/s	56.5605 Ops/s	$\textbf{\color{#35bf28}+54.34\%}$
test_values[td0_return_estimate-False-False]	0.2331ms	0.1299ms	7.6967 KOps/s	7.6138 KOps/s	$\color{#35bf28}+1.09\%$
test_values[td1_return_estimate-False-False]	28.3732ms	27.8564ms	35.8984 Ops/s	35.6621 Ops/s	$\color{#35bf28}+0.66\%$
test_values[vec_td1_return_estimate-False-False]	12.1750ms	11.3184ms	88.3515 Ops/s	55.9833 Ops/s	$\textbf{\color{#35bf28}+57.82\%}$
test_values[td_lambda_return_estimate-True-False]	43.3576ms	41.5537ms	24.0652 Ops/s	24.1898 Ops/s	$\color{#d91a1a}-0.52\%$
test_values[vec_td_lambda_return_estimate-True-False]	18.7336ms	12.0737ms	82.8243 Ops/s	55.7556 Ops/s	$\textbf{\color{#35bf28}+48.55\%}$
test_gae_speed[generalized_advantage_estimate-False-1-512]	9.4772ms	9.3464ms	106.9934 Ops/s	107.2641 Ops/s	$\color{#d91a1a}-0.25\%$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512]	1.7442ms	1.5563ms	642.5667 Ops/s	654.3734 Ops/s	$\color{#d91a1a}-1.80\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512]	0.4726ms	0.4233ms	2.3622 KOps/s	2.3646 KOps/s	$\color{#d91a1a}-0.10\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512]	34.4857ms	29.7834ms	33.5757 Ops/s	28.7320 Ops/s	$\textbf{\color{#35bf28}+16.86\%}$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512]	2.1889ms	1.7876ms	559.4243 Ops/s	562.4302 Ops/s	$\color{#d91a1a}-0.53\%$
test_dqn_speed[False-None]	1.8691ms	1.4330ms	697.8576 Ops/s	691.2199 Ops/s	$\color{#35bf28}+0.96\%$
test_dqn_speed[False-backward]	1.9890ms	1.9442ms	514.3586 Ops/s	512.0038 Ops/s	$\color{#35bf28}+0.46\%$
test_dqn_speed[True-None]	0.6869ms	0.5453ms	1.8339 KOps/s	1.7982 KOps/s	$\color{#35bf28}+1.98\%$
test_dqn_speed[True-backward]	1.0174ms	0.9847ms	1.0155 KOps/s	890.0054 Ops/s	$\textbf{\color{#35bf28}+14.10\%}$
test_dqn_speed[reduce-overhead-None]	0.8243ms	0.5311ms	1.8827 KOps/s	1.8671 KOps/s	$\color{#35bf28}+0.84\%$
test_dqn_speed[reduce-overhead-backward]	1.0229ms	0.9770ms	1.0235 KOps/s	939.3713 Ops/s	$\textbf{\color{#35bf28}+8.96\%}$
test_ddpg_speed[False-None]	3.2271ms	2.9072ms	343.9700 Ops/s	337.2755 Ops/s	$\color{#35bf28}+1.98\%$
test_ddpg_speed[False-backward]	4.2493ms	4.1244ms	242.4575 Ops/s	241.9428 Ops/s	$\color{#35bf28}+0.21\%$
test_ddpg_speed[True-None]	1.6204ms	1.3987ms	714.9498 Ops/s	683.8510 Ops/s	$\color{#35bf28}+4.55\%$
test_ddpg_speed[True-backward]	2.4254ms	2.3781ms	420.5048 Ops/s	343.2219 Ops/s	$\textbf{\color{#35bf28}+22.52\%}$
test_ddpg_speed[reduce-overhead-None]	1.7628ms	1.3986ms	715.0142 Ops/s	695.1549 Ops/s	$\color{#35bf28}+2.86\%$
test_ddpg_speed[reduce-overhead-backward]	2.4192ms	2.3589ms	423.9192 Ops/s	414.4266 Ops/s	$\color{#35bf28}+2.29\%$
test_sac_speed[False-None]	8.4131ms	7.9764ms	125.3692 Ops/s	123.7140 Ops/s	$\color{#35bf28}+1.34\%$
test_sac_speed[False-backward]	11.7296ms	11.2792ms	88.6588 Ops/s	88.0069 Ops/s	$\color{#35bf28}+0.74\%$
test_sac_speed[True-None]	2.5206ms	2.1281ms	469.9086 Ops/s	452.1009 Ops/s	$\color{#35bf28}+3.94\%$
test_sac_speed[True-backward]	4.1948ms	4.0487ms	246.9953 Ops/s	246.1704 Ops/s	$\color{#35bf28}+0.34\%$
test_sac_speed[reduce-overhead-None]	2.4903ms	2.1236ms	470.8898 Ops/s	460.7065 Ops/s	$\color{#35bf28}+2.21\%$
test_sac_speed[reduce-overhead-backward]	4.2768ms	4.0486ms	246.9978 Ops/s	227.5090 Ops/s	$\textbf{\color{#35bf28}+8.57\%}$
test_redq_speed[False-None]	10.9545ms	10.3424ms	96.6895 Ops/s	95.8138 Ops/s	$\color{#35bf28}+0.91\%$
test_redq_speed[False-backward]	18.7133ms	17.8769ms	55.9381 Ops/s	56.0136 Ops/s	$\color{#d91a1a}-0.13\%$
test_redq_speed[True-None]	4.8351ms	4.3912ms	227.7303 Ops/s	220.5686 Ops/s	$\color{#35bf28}+3.25\%$
test_redq_speed[True-backward]	10.1341ms	9.6108ms	104.0491 Ops/s	103.0127 Ops/s	$\color{#35bf28}+1.01\%$
test_redq_speed[reduce-overhead-None]	4.8372ms	4.4122ms	226.6439 Ops/s	224.2770 Ops/s	$\color{#35bf28}+1.06\%$
test_redq_speed[reduce-overhead-backward]	9.9765ms	9.8499ms	101.5239 Ops/s	104.0444 Ops/s	$\color{#d91a1a}-2.42\%$
test_redq_deprec_speed[False-None]	11.3101ms	10.9557ms	91.2766 Ops/s	88.8340 Ops/s	$\color{#35bf28}+2.75\%$
test_redq_deprec_speed[False-backward]	16.1333ms	15.7090ms	63.6579 Ops/s	62.5913 Ops/s	$\color{#35bf28}+1.70\%$
test_redq_deprec_speed[True-None]	4.0326ms	3.5916ms	278.4266 Ops/s	269.3320 Ops/s	$\color{#35bf28}+3.38\%$
test_redq_deprec_speed[True-backward]	7.7425ms	7.3418ms	136.2058 Ops/s	128.9781 Ops/s	$\textbf{\color{#35bf28}+5.60\%}$
test_redq_deprec_speed[reduce-overhead-None]	3.9438ms	3.5353ms	282.8601 Ops/s	273.3281 Ops/s	$\color{#35bf28}+3.49\%$
test_redq_deprec_speed[reduce-overhead-backward]	7.5833ms	7.3638ms	135.7989 Ops/s	136.7033 Ops/s	$\color{#d91a1a}-0.66\%$
test_td3_speed[False-None]	8.1885ms	8.0859ms	123.6715 Ops/s	121.9866 Ops/s	$\color{#35bf28}+1.38\%$
test_td3_speed[False-backward]	11.4240ms	10.9926ms	90.9702 Ops/s	90.0903 Ops/s	$\color{#35bf28}+0.98\%$
test_td3_speed[True-None]	1.8654ms	1.8128ms	551.6300 Ops/s	537.2126 Ops/s	$\color{#35bf28}+2.68\%$
test_td3_speed[True-backward]	3.7292ms	3.6178ms	276.4091 Ops/s	272.9140 Ops/s	$\color{#35bf28}+1.28\%$
test_td3_speed[reduce-overhead-None]	1.8431ms	1.8089ms	552.8250 Ops/s	551.4170 Ops/s	$\color{#35bf28}+0.26\%$
test_td3_speed[reduce-overhead-backward]	3.8681ms	3.7046ms	269.9363 Ops/s	274.1255 Ops/s	$\color{#d91a1a}-1.53\%$
test_cql_speed[False-None]	28.6327ms	25.8599ms	38.6699 Ops/s	38.0846 Ops/s	$\color{#35bf28}+1.54\%$
test_cql_speed[False-backward]	38.3467ms	35.5539ms	28.1263 Ops/s	28.1558 Ops/s	$\color{#d91a1a}-0.10\%$
test_cql_speed[True-None]	12.3646ms	12.0226ms	83.1766 Ops/s	79.2628 Ops/s	$\color{#35bf28}+4.94\%$
test_cql_speed[True-backward]	17.8097ms	17.4303ms	57.3715 Ops/s	57.0252 Ops/s	$\color{#35bf28}+0.61\%$
test_cql_speed[reduce-overhead-None]	12.7646ms	12.2958ms	81.3286 Ops/s	78.6905 Ops/s	$\color{#35bf28}+3.35\%$
test_cql_speed[reduce-overhead-backward]	18.1687ms	17.6706ms	56.5911 Ops/s	54.5849 Ops/s	$\color{#35bf28}+3.68\%$
test_a2c_speed[False-None]	5.8591ms	5.4088ms	184.8830 Ops/s	184.1800 Ops/s	$\color{#35bf28}+0.38\%$
test_a2c_speed[False-backward]	12.2759ms	11.8409ms	84.4531 Ops/s	83.3099 Ops/s	$\color{#35bf28}+1.37\%$
test_a2c_speed[True-None]	4.0397ms	3.6891ms	271.0654 Ops/s	255.7306 Ops/s	$\textbf{\color{#35bf28}+6.00\%}$
test_a2c_speed[True-backward]	8.9247ms	8.6200ms	116.0089 Ops/s	110.3802 Ops/s	$\textbf{\color{#35bf28}+5.10\%}$
test_a2c_speed[reduce-overhead-None]	4.1891ms	3.7211ms	268.7385 Ops/s	264.0572 Ops/s	$\color{#35bf28}+1.77\%$
test_a2c_speed[reduce-overhead-backward]	9.2301ms	8.7702ms	114.0220 Ops/s	112.7778 Ops/s	$\color{#35bf28}+1.10\%$
test_ppo_speed[False-None]	6.3355ms	5.9096ms	169.2156 Ops/s	165.7724 Ops/s	$\color{#35bf28}+2.08\%$
test_ppo_speed[False-backward]	12.8115ms	12.5373ms	79.7620 Ops/s	78.5092 Ops/s	$\color{#35bf28}+1.60\%$
test_ppo_speed[True-None]	3.7524ms	3.6061ms	277.3067 Ops/s	270.7614 Ops/s	$\color{#35bf28}+2.42\%$
test_ppo_speed[True-backward]	8.7096ms	8.4550ms	118.2730 Ops/s	117.4667 Ops/s	$\color{#35bf28}+0.69\%$
test_ppo_speed[reduce-overhead-None]	3.8894ms	3.5738ms	279.8110 Ops/s	272.1556 Ops/s	$\color{#35bf28}+2.81\%$
test_ppo_speed[reduce-overhead-backward]	9.1803ms	8.7500ms	114.2863 Ops/s	113.4125 Ops/s	$\color{#35bf28}+0.77\%$
test_reinforce_speed[False-None]	4.7665ms	4.5362ms	220.4510 Ops/s	212.2116 Ops/s	$\color{#35bf28}+3.88\%$
test_reinforce_speed[False-backward]	7.5822ms	7.4080ms	134.9888 Ops/s	133.0071 Ops/s	$\color{#35bf28}+1.49\%$
test_reinforce_speed[True-None]	3.0041ms	2.8630ms	349.2861 Ops/s	335.3272 Ops/s	$\color{#35bf28}+4.16\%$
test_reinforce_speed[True-backward]	8.1849ms	7.7155ms	129.6099 Ops/s	113.1112 Ops/s	$\textbf{\color{#35bf28}+14.59\%}$
test_reinforce_speed[reduce-overhead-None]	2.9902ms	2.8249ms	353.9913 Ops/s	338.1599 Ops/s	$\color{#35bf28}+4.68\%$
test_reinforce_speed[reduce-overhead-backward]	8.4264ms	7.9964ms	125.0556 Ops/s	123.3633 Ops/s	$\color{#35bf28}+1.37\%$
test_iql_speed[False-None]	21.0107ms	19.9332ms	50.1675 Ops/s	49.2237 Ops/s	$\color{#35bf28}+1.92\%$
test_iql_speed[False-backward]	31.5846ms	30.4408ms	32.8506 Ops/s	32.4887 Ops/s	$\color{#35bf28}+1.11\%$
test_iql_speed[True-None]	8.7683ms	8.4482ms	118.3689 Ops/s	116.2239 Ops/s	$\color{#35bf28}+1.85\%$
test_iql_speed[True-backward]	17.7135ms	16.6844ms	59.9361 Ops/s	60.0867 Ops/s	$\color{#d91a1a}-0.25\%$
test_iql_speed[reduce-overhead-None]	8.9795ms	8.5105ms	117.5023 Ops/s	115.5606 Ops/s	$\color{#35bf28}+1.68\%$
test_iql_speed[reduce-overhead-backward]	17.8962ms	17.2026ms	58.1306 Ops/s	58.3553 Ops/s	$\color{#d91a1a}-0.38\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	8.2244ms	6.2347ms	160.3928 Ops/s	162.1017 Ops/s	$\color{#d91a1a}-1.05\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	0.6227ms	0.2935ms	3.4073 KOps/s	3.2891 KOps/s	$\color{#35bf28}+3.59\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5802ms	0.2735ms	3.6564 KOps/s	3.7694 KOps/s	$\color{#d91a1a}-3.00\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.1560ms	5.9103ms	169.1957 Ops/s	170.2346 Ops/s	$\color{#d91a1a}-0.61\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	1.8401ms	0.3215ms	3.1102 KOps/s	3.5367 KOps/s	$\textbf{\color{#d91a1a}-12.06\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.5724ms	0.2890ms	3.4601 KOps/s	3.3180 KOps/s	$\color{#35bf28}+4.28\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000]	1.4751ms	1.2718ms	786.2627 Ops/s	787.0545 Ops/s	$\color{#d91a1a}-0.10\%$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000]	1.5454ms	1.1895ms	840.6954 Ops/s	843.9089 Ops/s	$\color{#d91a1a}-0.38\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	9.7522ms	6.2305ms	160.5020 Ops/s	165.5715 Ops/s	$\color{#d91a1a}-3.06\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.2776ms	0.4942ms	2.0234 KOps/s	1.9072 KOps/s	$\textbf{\color{#35bf28}+6.09\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.7840ms	0.4340ms	2.3040 KOps/s	1.9672 KOps/s	$\textbf{\color{#35bf28}+17.12\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000]	6.0294ms	5.9261ms	168.7442 Ops/s	169.4631 Ops/s	$\color{#d91a1a}-0.42\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000]	2.2146ms	0.3308ms	3.0231 KOps/s	2.5865 KOps/s	$\textbf{\color{#35bf28}+16.88\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000]	0.5050ms	0.3012ms	3.3196 KOps/s	2.7326 KOps/s	$\textbf{\color{#35bf28}+21.48\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000]	6.1560ms	5.8631ms	170.5590 Ops/s	170.7920 Ops/s	$\color{#d91a1a}-0.14\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000]	2.2035ms	0.2846ms	3.5139 KOps/s	631.1130 Ops/s	$\textbf{\color{#35bf28}+456.78\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000]	0.5995ms	0.2782ms	3.5950 KOps/s	3.1581 KOps/s	$\textbf{\color{#35bf28}+13.83\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000]	6.4298ms	6.0945ms	164.0832 Ops/s	163.2618 Ops/s	$\color{#35bf28}+0.50\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000]	1.1338ms	0.4485ms	2.2297 KOps/s	2.0351 KOps/s	$\textbf{\color{#35bf28}+9.56\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000]	0.6395ms	0.4323ms	2.3135 KOps/s	2.0118 KOps/s	$\textbf{\color{#35bf28}+14.99\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400]	6.3500ms	4.9403ms	202.4172 Ops/s	193.8289 Ops/s	$\color{#35bf28}+4.43\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400]	9.8896ms	2.3184ms	431.3305 Ops/s	470.8199 Ops/s	$\textbf{\color{#d91a1a}-8.39\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400]	7.0306ms	1.1934ms	837.9560 Ops/s	816.8414 Ops/s	$\color{#35bf28}+2.58\%$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400]	6.5046ms	5.0718ms	197.1678 Ops/s	194.9796 Ops/s	$\color{#35bf28}+1.12\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400]	9.9280ms	2.3749ms	421.0694 Ops/s	471.7658 Ops/s	$\textbf{\color{#d91a1a}-10.75\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400]	3.5731ms	1.2067ms	828.7373 Ops/s	868.8626 Ops/s	$\color{#d91a1a}-4.62\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400]	0.6118s	17.4362ms	57.3519 Ops/s	53.0631 Ops/s	$\textbf{\color{#35bf28}+8.08\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400]	4.0447ms	1.8837ms	530.8610 Ops/s	457.0914 Ops/s	$\textbf{\color{#35bf28}+16.14\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400]	10.8482ms	1.3704ms	729.7385 Ops/s	749.9676 Ops/s	$\color{#d91a1a}-2.70\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True]	39.2575ms	34.9504ms	28.6120 Ops/s	28.1803 Ops/s	$\color{#35bf28}+1.53\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False]	19.7004ms	18.4227ms	54.2810 Ops/s	55.2879 Ops/s	$\color{#d91a1a}-1.82\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True]	39.5023ms	36.7390ms	27.2190 Ops/s	27.8915 Ops/s	$\color{#d91a1a}-2.41\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False]	20.2707ms	18.7296ms	53.3914 Ops/s	54.1255 Ops/s	$\color{#d91a1a}-1.36\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True]	39.4585ms	37.9117ms	26.3771 Ops/s	26.5333 Ops/s	$\color{#d91a1a}-0.59\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False]	21.3564ms	19.7141ms	50.7252 Ops/s	50.2024 Ops/s	$\color{#35bf28}+1.04\%$