Skip to content

[CI] Add torch_geometric integration tests#3552

Open
vmoens wants to merge 1 commit intomainfrom
ci/torch-geometric-tests
Open

[CI] Add torch_geometric integration tests#3552
vmoens wants to merge 1 commit intomainfrom
ci/torch-geometric-tests

Conversation

@vmoens
Copy link
Collaborator

@vmoens vmoens commented Mar 14, 2026

Summary

  • Adds a TestTorchGeometric test class to test/test_libs.py with 5 tests covering deepcopy compatibility, collector integration, and TensorDictModule wrapping with torch_geometric layers (addresses [BUG] torch geometric layers not working in policy network #2679)
  • Adds CI job unittests-torch_geometric to test-linux-libs.yml with dedicated scripts, triggered by Integrations / Integrations/torch_geometric labels
  • Adds auto-labeling rules for the new Integrations/torch_geometric label in .github/labeler.yml

Note: the original deepcopy bug from #2679 was fixed upstream in torch_geometric 2.7.0 (they removed the custom __deepcopy__ from Linear). These tests serve as a regression guard to catch any future incompatibility on either side.

Test plan

  • TestTorchGeometric tests pass locally (4 passed, 1 skipped for no CUDA)
  • CI job runs successfully on GPU runner (exercises the CUDA cross-device collector test)

Made with Cursor

@vmoens
[CI] Add torch_geometric integration tests
438a967 
Add CI workflow and tests to verify torchrl compatibility with
torch_geometric (addresses #2679).

Tests cover:
- deepcopy of modules containing torch_geometric layers
- The collector's meta-device deepcopy pattern
- Collector integration with torch_geometric-based policies
- TensorDictModule wrapping of torch_geometric modules

Made-with: Cursor
@vmoens vmoens added the CI Has to do with CI setup (e.g. wheels & builds, tests...) label Mar 14, 2026
@pytorch-bot
Copy link

pytorch-bot bot commented Mar 14, 2026 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/rl/3552

Note: Links to docs will display an error until the docs builds have been completed.

❌ 5 New Failures, 1 Unrelated Failure

As of commit 438a967 with merge base a65ff5e (image):

NEW FAILURES - The following jobs have failed:

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 14, 2026
@github-actions github-actions bot added the Environments Adds or modifies an environment wrapper label Mar 14, 2026
@github-actions
Copy link
Contributor

github-actions bot commented Mar 14, 2026

$\color{#D29922}\textsf{\Large⚠\kern{0.2cm}\normalsize Warning}$ Result of GPU Benchmark Tests

Total Benchmarks: 172. Improved: $\large\color{#35bf28}16$. Worsened: $\large\color{#d91a1a}8$.

Expand to view detailed results
Name Max Mean Ops Ops on Repo HEAD Change
test_tensor_to_bytestream_speed[pickle] 81.6798μs 80.0597μs 12.4907 KOps/s 11.8147 KOps/s $\textbf{\color{#35bf28}+5.72\%}$
test_tensor_to_bytestream_speed[torch.save] 0.1412ms 0.1401ms 7.1363 KOps/s 7.0442 KOps/s $\color{#35bf28}+1.31\%$
test_tensor_to_bytestream_speed[untyped_storage] 0.1172s 0.1168s 8.5602 Ops/s 9.3420 Ops/s $\textbf{\color{#d91a1a}-8.37\%}$
test_tensor_to_bytestream_speed[numpy] 2.6062μs 2.5862μs 386.6731 KOps/s 383.7261 KOps/s $\color{#35bf28}+0.77\%$
test_tensor_to_bytestream_speed[safetensors] 38.1401μs 37.5374μs 26.6401 KOps/s 27.1882 KOps/s $\color{#d91a1a}-2.02\%$
test_simple 0.7885s 0.7878s 1.2694 Ops/s 1.2237 Ops/s $\color{#35bf28}+3.73\%$
test_transformed 1.4932s 1.4006s 0.7140 Ops/s 0.7121 Ops/s $\color{#35bf28}+0.26\%$
test_serial 2.3140s 2.3126s 0.4324 Ops/s 0.4276 Ops/s $\color{#35bf28}+1.13\%$
test_parallel 1.9055s 1.8210s 0.5492 Ops/s 0.5438 Ops/s $\color{#35bf28}+0.99\%$
test_step_mdp_speed[True-True-True-True-True] 0.1905ms 41.8478μs 23.8961 KOps/s 23.9415 KOps/s $\color{#d91a1a}-0.19\%$
test_step_mdp_speed[True-True-True-True-False] 63.4430μs 22.8049μs 43.8502 KOps/s 43.3450 KOps/s $\color{#35bf28}+1.17\%$
test_step_mdp_speed[True-True-True-False-True] 70.5330μs 22.7953μs 43.8688 KOps/s 43.6993 KOps/s $\color{#35bf28}+0.39\%$
test_step_mdp_speed[True-True-True-False-False] 37.1810μs 12.5875μs 79.4437 KOps/s 78.0666 KOps/s $\color{#35bf28}+1.76\%$
test_step_mdp_speed[True-True-False-True-True] 82.8230μs 43.2672μs 23.1122 KOps/s 22.6501 KOps/s $\color{#35bf28}+2.04\%$
test_step_mdp_speed[True-True-False-True-False] 91.1640μs 24.9275μs 40.1163 KOps/s 39.4401 KOps/s $\color{#35bf28}+1.71\%$
test_step_mdp_speed[True-True-False-False-True] 65.7430μs 25.5821μs 39.0898 KOps/s 39.1137 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[True-True-False-False-False] 63.3230μs 15.2462μs 65.5899 KOps/s 65.1659 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[True-False-True-True-True] 0.1134ms 46.8353μs 21.3514 KOps/s 21.8470 KOps/s $\color{#d91a1a}-2.27\%$
test_step_mdp_speed[True-False-True-True-False] 65.1530μs 28.3215μs 35.3089 KOps/s 35.8412 KOps/s $\color{#d91a1a}-1.49\%$
test_step_mdp_speed[True-False-True-False-True] 64.2420μs 25.4095μs 39.3553 KOps/s 39.0257 KOps/s $\color{#35bf28}+0.84\%$
test_step_mdp_speed[True-False-True-False-False] 64.4120μs 15.3340μs 65.2145 KOps/s 65.8189 KOps/s $\color{#d91a1a}-0.92\%$
test_step_mdp_speed[True-False-False-True-True] 0.2251ms 48.7146μs 20.5277 KOps/s 20.2886 KOps/s $\color{#35bf28}+1.18\%$
test_step_mdp_speed[True-False-False-True-False] 82.9040μs 30.4694μs 32.8198 KOps/s 32.9113 KOps/s $\color{#d91a1a}-0.28\%$
test_step_mdp_speed[True-False-False-False-True] 71.5930μs 28.6865μs 34.8596 KOps/s 35.3153 KOps/s $\color{#d91a1a}-1.29\%$
test_step_mdp_speed[True-False-False-False-False] 49.4920μs 17.8829μs 55.9194 KOps/s 56.3325 KOps/s $\color{#d91a1a}-0.73\%$
test_step_mdp_speed[False-True-True-True-True] 0.1496ms 46.3517μs 21.5742 KOps/s 21.5877 KOps/s $\color{#d91a1a}-0.06\%$
test_step_mdp_speed[False-True-True-True-False] 0.4348ms 27.5924μs 36.2418 KOps/s 35.8287 KOps/s $\color{#35bf28}+1.15\%$
test_step_mdp_speed[False-True-True-False-True] 2.4231ms 29.4057μs 34.0070 KOps/s 33.2434 KOps/s $\color{#35bf28}+2.30\%$
test_step_mdp_speed[False-True-True-False-False] 56.4030μs 16.8583μs 59.3179 KOps/s 57.9545 KOps/s $\color{#35bf28}+2.35\%$
test_step_mdp_speed[False-True-False-True-True] 0.1085ms 48.4357μs 20.6459 KOps/s 20.7963 KOps/s $\color{#d91a1a}-0.72\%$
test_step_mdp_speed[False-True-False-True-False] 62.8530μs 30.0703μs 33.2554 KOps/s 33.3755 KOps/s $\color{#d91a1a}-0.36\%$
test_step_mdp_speed[False-True-False-False-True] 0.1056ms 31.1791μs 32.0728 KOps/s 31.7817 KOps/s $\color{#35bf28}+0.92\%$
test_step_mdp_speed[False-True-False-False-False] 48.0720μs 19.2149μs 52.0429 KOps/s 51.4185 KOps/s $\color{#35bf28}+1.21\%$
test_step_mdp_speed[False-False-True-True-True] 0.1035ms 51.1450μs 19.5522 KOps/s 19.5010 KOps/s $\color{#35bf28}+0.26\%$
test_step_mdp_speed[False-False-True-True-False] 63.2030μs 32.4508μs 30.8158 KOps/s 30.1323 KOps/s $\color{#35bf28}+2.27\%$
test_step_mdp_speed[False-False-True-False-True] 78.6630μs 31.3716μs 31.8760 KOps/s 31.6822 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-False-True-False-False] 55.3930μs 19.2831μs 51.8588 KOps/s 51.8937 KOps/s $\color{#d91a1a}-0.07\%$
test_step_mdp_speed[False-False-False-True-True] 0.1237ms 53.1633μs 18.8100 KOps/s 18.7998 KOps/s $\color{#35bf28}+0.05\%$
test_step_mdp_speed[False-False-False-True-False] 75.2540μs 35.0026μs 28.5693 KOps/s 28.3963 KOps/s $\color{#35bf28}+0.61\%$
test_step_mdp_speed[False-False-False-False-True] 96.5640μs 33.3005μs 30.0295 KOps/s 29.8370 KOps/s $\color{#35bf28}+0.65\%$
test_step_mdp_speed[False-False-False-False-False] 54.4130μs 21.7914μs 45.8896 KOps/s 46.2835 KOps/s $\color{#d91a1a}-0.85\%$
test_non_tensor_env_rollout_speed[1000-single-True] 0.7493s 0.7241s 1.3811 Ops/s 1.3515 Ops/s $\color{#35bf28}+2.19\%$
test_non_tensor_env_rollout_speed[1000-single-False] 0.7091s 0.6098s 1.6400 Ops/s 1.6699 Ops/s $\color{#d91a1a}-1.79\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-True] 1.7205s 1.6418s 0.6091 Ops/s 0.6134 Ops/s $\color{#d91a1a}-0.70\%$
test_non_tensor_env_rollout_speed[1000-serial-no-buffers-False] 1.5152s 1.4312s 0.6987 Ops/s 0.7085 Ops/s $\color{#d91a1a}-1.37\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-True] 1.9827s 1.9020s 0.5258 Ops/s 0.5311 Ops/s $\color{#d91a1a}-1.01\%$
test_non_tensor_env_rollout_speed[1000-serial-buffers-False] 1.7444s 1.6686s 0.5993 Ops/s 0.6034 Ops/s $\color{#d91a1a}-0.68\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-True] 4.6968s 4.6156s 0.2167 Ops/s 0.2172 Ops/s $\color{#d91a1a}-0.23\%$
test_non_tensor_env_rollout_speed[1000-parallel-no-buffers-False] 4.4750s 4.4194s 0.2263 Ops/s 0.2255 Ops/s $\color{#35bf28}+0.34\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-True] 1.9375s 1.8708s 0.5345 Ops/s 0.5299 Ops/s $\color{#35bf28}+0.87\%$
test_non_tensor_env_rollout_speed[1000-parallel-buffers-False] 1.7206s 1.6068s 0.6223 Ops/s 0.6277 Ops/s $\color{#d91a1a}-0.86\%$
test_values[generalized_advantage_estimate-True-True] 21.0205ms 19.9746ms 50.0636 Ops/s 49.0228 Ops/s $\color{#35bf28}+2.12\%$
test_values[vec_generalized_advantage_estimate-True-True] 0.1329s 3.5766ms 279.5935 Ops/s 257.3275 Ops/s $\textbf{\color{#35bf28}+8.65\%}$
test_values[td0_return_estimate-False-False] 0.1068ms 83.1494μs 12.0265 KOps/s 11.9863 KOps/s $\color{#35bf28}+0.34\%$
test_values[td1_return_estimate-False-False] 51.4191ms 49.3937ms 20.2455 Ops/s 20.1704 Ops/s $\color{#35bf28}+0.37\%$
test_values[vec_td1_return_estimate-False-False] 1.3589ms 1.0902ms 917.2829 Ops/s 922.1523 Ops/s $\color{#d91a1a}-0.53\%$
test_values[td_lambda_return_estimate-True-False] 84.2181ms 81.3615ms 12.2908 Ops/s 12.0100 Ops/s $\color{#35bf28}+2.34\%$
test_values[vec_td_lambda_return_estimate-True-False] 1.3232ms 1.0884ms 918.7774 Ops/s 917.8165 Ops/s $\color{#35bf28}+0.10\%$
test_gae_speed[generalized_advantage_estimate-False-1-512] 21.6519ms 20.5639ms 48.6290 Ops/s 44.9585 Ops/s $\textbf{\color{#35bf28}+8.16\%}$
test_gae_speed[vec_generalized_advantage_estimate-True-1-512] 1.0310ms 0.7870ms 1.2706 KOps/s 1.3241 KOps/s $\color{#d91a1a}-4.04\%$
test_gae_speed[vec_generalized_advantage_estimate-False-1-512] 0.8094ms 0.6949ms 1.4390 KOps/s 1.4503 KOps/s $\color{#d91a1a}-0.78\%$
test_gae_speed[vec_generalized_advantage_estimate-True-32-512] 1.5710ms 1.4977ms 667.6686 Ops/s 655.6109 Ops/s $\color{#35bf28}+1.84\%$
test_gae_speed[vec_generalized_advantage_estimate-False-32-512] 0.7616ms 0.7064ms 1.4156 KOps/s 1.3770 KOps/s $\color{#35bf28}+2.81\%$
test_dqn_speed[False-None] 1.7279ms 1.5487ms 645.6823 Ops/s 641.5156 Ops/s $\color{#35bf28}+0.65\%$
test_dqn_speed[False-backward] 2.3757ms 2.1869ms 457.2679 Ops/s 457.1264 Ops/s $\color{#35bf28}+0.03\%$
test_dqn_speed[True-None] 1.3948ms 0.5957ms 1.6787 KOps/s 1.7089 KOps/s $\color{#d91a1a}-1.77\%$
test_dqn_speed[True-backward] 1.2931ms 1.2469ms 801.9589 Ops/s 887.8939 Ops/s $\textbf{\color{#d91a1a}-9.68\%}$
test_dqn_speed[reduce-overhead-None] 1.0907ms 0.6081ms 1.6444 KOps/s 1.6112 KOps/s $\color{#35bf28}+2.06\%$
test_ddpg_speed[False-None] 3.3120ms 2.8858ms 346.5257 Ops/s 354.2565 Ops/s $\color{#d91a1a}-2.18\%$
test_ddpg_speed[False-backward] 4.8564ms 4.3479ms 229.9941 Ops/s 240.7260 Ops/s $\color{#d91a1a}-4.46\%$
test_ddpg_speed[True-None] 1.8859ms 1.3804ms 724.4434 Ops/s 712.5680 Ops/s $\color{#35bf28}+1.67\%$
test_ddpg_speed[True-backward] 2.4992ms 2.4509ms 408.0122 Ops/s 408.9444 Ops/s $\color{#d91a1a}-0.23\%$
test_ddpg_speed[reduce-overhead-None] 1.6023ms 1.4177ms 705.3487 Ops/s 706.7339 Ops/s $\color{#d91a1a}-0.20\%$
test_sac_speed[False-None] 8.8302ms 8.4247ms 118.6987 Ops/s 120.6043 Ops/s $\color{#d91a1a}-1.58\%$
test_sac_speed[False-backward] 11.9100ms 11.4076ms 87.6606 Ops/s 89.0024 Ops/s $\color{#d91a1a}-1.51\%$
test_sac_speed[True-None] 2.3720ms 1.9108ms 523.3402 Ops/s 527.5190 Ops/s $\color{#d91a1a}-0.79\%$
test_sac_speed[True-backward] 4.1708ms 3.5873ms 278.7588 Ops/s 267.0229 Ops/s $\color{#35bf28}+4.40\%$
test_sac_speed[reduce-overhead-None] 16.4322ms 10.0284ms 99.7171 Ops/s 84.6438 Ops/s $\textbf{\color{#35bf28}+17.81\%}$
test_redq_deprec_speed[False-None] 10.3129ms 9.4436ms 105.8923 Ops/s 105.1655 Ops/s $\color{#35bf28}+0.69\%$
test_redq_deprec_speed[False-backward] 13.0780ms 12.5341ms 79.7826 Ops/s 77.8842 Ops/s $\color{#35bf28}+2.44\%$
test_redq_deprec_speed[True-None] 2.7889ms 2.6376ms 379.1290 Ops/s 368.8803 Ops/s $\color{#35bf28}+2.78\%$
test_redq_deprec_speed[True-backward] 4.7179ms 4.3212ms 231.4161 Ops/s 229.1841 Ops/s $\color{#35bf28}+0.97\%$
test_redq_deprec_speed[reduce-overhead-None] 14.5628ms 9.6096ms 104.0623 Ops/s 103.5209 Ops/s $\color{#35bf28}+0.52\%$
test_td3_speed[False-None] 8.7350ms 8.3499ms 119.7625 Ops/s 120.8812 Ops/s $\color{#d91a1a}-0.93\%$
test_td3_speed[False-backward] 11.3935ms 10.9089ms 91.6681 Ops/s 93.5629 Ops/s $\color{#d91a1a}-2.03\%$
test_td3_speed[True-None] 1.7178ms 1.6898ms 591.7912 Ops/s 593.6898 Ops/s $\color{#d91a1a}-0.32\%$
test_td3_speed[True-backward] 3.3520ms 3.2902ms 303.9303 Ops/s 320.7884 Ops/s $\textbf{\color{#d91a1a}-5.26\%}$
test_td3_speed[reduce-overhead-None] 49.2283ms 25.1274ms 39.7971 Ops/s 39.5770 Ops/s $\color{#35bf28}+0.56\%$
test_cql_speed[False-None] 17.7438ms 17.5001ms 57.1425 Ops/s 57.4317 Ops/s $\color{#d91a1a}-0.50\%$
test_cql_speed[False-backward] 23.5114ms 23.0683ms 43.3495 Ops/s 44.1796 Ops/s $\color{#d91a1a}-1.88\%$
test_cql_speed[True-None] 3.6158ms 3.3860ms 295.3365 Ops/s 296.8376 Ops/s $\color{#d91a1a}-0.51\%$
test_cql_speed[True-backward] 6.1729ms 5.7652ms 173.4531 Ops/s 179.4298 Ops/s $\color{#d91a1a}-3.33\%$
test_cql_speed[reduce-overhead-None] 17.8886ms 11.8489ms 84.3958 Ops/s 54.8124 Ops/s $\textbf{\color{#35bf28}+53.97\%}$
test_a2c_speed[False-None] 3.4324ms 3.2633ms 306.4405 Ops/s 311.2000 Ops/s $\color{#d91a1a}-1.53\%$
test_a2c_speed[False-backward] 7.1898ms 6.4192ms 155.7826 Ops/s 161.8445 Ops/s $\color{#d91a1a}-3.75\%$
test_a2c_speed[True-None] 1.4781ms 1.3910ms 718.9091 Ops/s 723.6113 Ops/s $\color{#d91a1a}-0.65\%$
test_a2c_speed[True-backward] 3.2740ms 3.2234ms 310.2338 Ops/s 301.4944 Ops/s $\color{#35bf28}+2.90\%$
test_a2c_speed[reduce-overhead-None] 1.1036ms 1.0331ms 967.9245 Ops/s 960.7679 Ops/s $\color{#35bf28}+0.74\%$
test_ppo_speed[False-None] 4.0625ms 3.8892ms 257.1243 Ops/s 251.8616 Ops/s $\color{#35bf28}+2.09\%$
test_ppo_speed[False-backward] 7.7073ms 7.2941ms 137.0980 Ops/s 142.3609 Ops/s $\color{#d91a1a}-3.70\%$
test_ppo_speed[True-None] 1.6313ms 1.5066ms 663.7608 Ops/s 662.7505 Ops/s $\color{#35bf28}+0.15\%$
test_ppo_speed[True-backward] 3.8274ms 3.4388ms 290.8016 Ops/s 296.7293 Ops/s $\color{#d91a1a}-2.00\%$
test_ppo_speed[reduce-overhead-None] 1.1705ms 1.0873ms 919.7376 Ops/s 902.8513 Ops/s $\color{#35bf28}+1.87\%$
test_reinforce_speed[False-None] 2.4038ms 2.2968ms 435.3975 Ops/s 435.7982 Ops/s $\color{#d91a1a}-0.09\%$
test_reinforce_speed[False-backward] 3.9040ms 3.4512ms 289.7563 Ops/s 302.6423 Ops/s $\color{#d91a1a}-4.26\%$
test_reinforce_speed[True-None] 1.4684ms 1.3485ms 741.5753 Ops/s 734.0404 Ops/s $\color{#35bf28}+1.03\%$
test_reinforce_speed[True-backward] 3.2858ms 3.1911ms 313.3686 Ops/s 310.4322 Ops/s $\color{#35bf28}+0.95\%$
test_reinforce_speed[reduce-overhead-None] 16.0991ms 8.9194ms 112.1154 Ops/s 111.9424 Ops/s $\color{#35bf28}+0.15\%$
test_iql_speed[False-None] 10.3146ms 9.5959ms 104.2108 Ops/s 105.2682 Ops/s $\color{#d91a1a}-1.00\%$
test_iql_speed[False-backward] 14.1103ms 13.5615ms 73.7384 Ops/s 73.9811 Ops/s $\color{#d91a1a}-0.33\%$
test_iql_speed[True-None] 2.4660ms 2.2800ms 438.6028 Ops/s 437.1511 Ops/s $\color{#35bf28}+0.33\%$
test_iql_speed[True-backward] 5.1328ms 5.0544ms 197.8464 Ops/s 196.8611 Ops/s $\color{#35bf28}+0.50\%$
test_iql_speed[reduce-overhead-None] 16.2713ms 9.9610ms 100.3912 Ops/s 99.9265 Ops/s $\color{#35bf28}+0.47\%$
test_rb_sample[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 6.5001ms 5.9970ms 166.7491 Ops/s 165.0690 Ops/s $\color{#35bf28}+1.02\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 0.6573ms 0.3514ms 2.8461 KOps/s 2.4514 KOps/s $\textbf{\color{#35bf28}+16.10\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.6552ms 0.3457ms 2.8923 KOps/s 2.4939 KOps/s $\textbf{\color{#35bf28}+15.97\%}$
test_rb_sample[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 6.0294ms 5.7797ms 173.0186 Ops/s 170.0998 Ops/s $\color{#35bf28}+1.72\%$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.9747ms 0.3002ms 3.3307 KOps/s 2.9753 KOps/s $\textbf{\color{#35bf28}+11.95\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.5501ms 0.2821ms 3.5450 KOps/s 3.3748 KOps/s $\textbf{\color{#35bf28}+5.05\%}$
test_rb_sample[TensorDictReplayBuffer-LazyMemmapStorage-sampler6-10000] 1.5153ms 1.2646ms 790.7352 Ops/s 711.4477 Ops/s $\textbf{\color{#35bf28}+11.14\%}$
test_rb_sample[TensorDictReplayBuffer-LazyTensorStorage-sampler7-10000] 1.4409ms 1.1887ms 841.2902 Ops/s 769.7169 Ops/s $\textbf{\color{#35bf28}+9.30\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.2393ms 5.9379ms 168.4102 Ops/s 167.7714 Ops/s $\color{#35bf28}+0.38\%$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 1.0964ms 0.4856ms 2.0594 KOps/s 1.8336 KOps/s $\textbf{\color{#35bf28}+12.32\%}$
test_rb_sample[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.7878ms 0.4735ms 2.1120 KOps/s 1.9907 KOps/s $\textbf{\color{#35bf28}+6.10\%}$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-RandomSampler-4000] 5.9565ms 5.7994ms 172.4310 Ops/s 172.0529 Ops/s $\color{#35bf28}+0.22\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-10000] 1.1536ms 0.3432ms 2.9135 KOps/s 3.3068 KOps/s $\textbf{\color{#d91a1a}-11.89\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-10000] 0.7099ms 0.3533ms 2.8301 KOps/s 2.7687 KOps/s $\color{#35bf28}+2.22\%$
test_rb_iterate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-4000] 5.9702ms 5.7196ms 174.8378 Ops/s 171.8343 Ops/s $\color{#35bf28}+1.75\%$
test_rb_iterate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-10000] 1.7757ms 0.2947ms 3.3934 KOps/s 2.9229 KOps/s $\textbf{\color{#35bf28}+16.10\%}$
test_rb_iterate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-10000] 0.4509ms 0.2707ms 3.6940 KOps/s 3.6926 KOps/s $\color{#35bf28}+0.04\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-ListStorage-None-4000] 6.0352ms 5.8279ms 171.5881 Ops/s 167.0416 Ops/s $\color{#35bf28}+2.72\%$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-10000] 2.0403ms 0.5150ms 1.9417 KOps/s 2.2685 KOps/s $\textbf{\color{#d91a1a}-14.41\%}$
test_rb_iterate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-10000] 0.6738ms 0.4543ms 2.2010 KOps/s 2.3851 KOps/s $\textbf{\color{#d91a1a}-7.72\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-RandomSampler-400] 0.9347s 23.6821ms 42.2261 Ops/s 44.2140 Ops/s $\color{#d91a1a}-4.50\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-RandomSampler-400] 12.1638ms 2.1468ms 465.8179 Ops/s 482.4523 Ops/s $\color{#d91a1a}-3.45\%$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-RandomSampler-400] 1.2836ms 0.9917ms 1.0084 KOps/s 725.5990 Ops/s $\textbf{\color{#35bf28}+38.98\%}$
test_rb_populate[TensorDictReplayBuffer-ListStorage-SamplerWithoutReplacement-400] 10.0207ms 5.0994ms 196.1028 Ops/s 191.9288 Ops/s $\color{#35bf28}+2.17\%$
test_rb_populate[TensorDictReplayBuffer-LazyMemmapStorage-SamplerWithoutReplacement-400] 4.1484ms 1.8955ms 527.5614 Ops/s 498.7192 Ops/s $\textbf{\color{#35bf28}+5.78\%}$
test_rb_populate[TensorDictReplayBuffer-LazyTensorStorage-SamplerWithoutReplacement-400] 1.2442ms 1.0026ms 997.4066 Ops/s 1.0231 KOps/s $\color{#d91a1a}-2.51\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-ListStorage-None-400] 0.6469s 18.4307ms 54.2573 Ops/s 185.3857 Ops/s $\textbf{\color{#d91a1a}-70.73\%}$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyMemmapStorage-None-400] 9.7639ms 2.1808ms 458.5525 Ops/s 455.7886 Ops/s $\color{#35bf28}+0.61\%$
test_rb_populate[TensorDictPrioritizedReplayBuffer-LazyTensorStorage-None-400] 2.3444ms 1.1701ms 854.6218 Ops/s 854.6861 Ops/s $-0.01\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-True] 41.0618ms 37.8820ms 26.3977 Ops/s 26.3213 Ops/s $\color{#35bf28}+0.29\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-10000-10000-100-False] 19.6685ms 18.0173ms 55.5023 Ops/s 54.8532 Ops/s $\color{#35bf28}+1.18\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-True] 41.9451ms 38.9334ms 25.6849 Ops/s 25.3542 Ops/s $\color{#35bf28}+1.30\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-100000-10000-100-False] 19.8915ms 18.4331ms 54.2502 Ops/s 53.1519 Ops/s $\color{#35bf28}+2.07\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-True] 43.6458ms 40.8669ms 24.4697 Ops/s 24.2621 Ops/s $\color{#35bf28}+0.86\%$
test_rb_extend_sample[ReplayBuffer-LazyTensorStorage-RandomSampler-1000000-10000-100-False] 21.9689ms 20.3573ms 49.1224 Ops/s 50.1006 Ops/s $\color{#d91a1a}-1.95\%$
test_storage_write_lazystack[50-img_shape0-small] 0.9706ms 0.2275ms 4.3959 KOps/s 4.4169 KOps/s $\color{#d91a1a}-0.48\%$
test_storage_write_lazystack[100-img_shape1-atari] 1.7343ms 1.4270ms 700.7714 Ops/s 678.8148 Ops/s $\color{#35bf28}+3.23\%$
test_storage_write_lazystack[100-img_shape2-large_img] 2.7666ms 2.3113ms 432.6520 Ops/s 432.8204 Ops/s $\color{#d91a1a}-0.04\%$
test_storage_write_lazystack[200-img_shape3-large_batch] 3.1874ms 2.9221ms 342.2188 Ops/s 329.3945 Ops/s $\color{#35bf28}+3.89\%$
test_storage_write_contiguous[50-img_shape0-small] 0.2371ms 0.1647ms 6.0731 KOps/s 6.0592 KOps/s $\color{#35bf28}+0.23\%$
test_storage_write_contiguous[100-img_shape1-atari] 0.3942ms 0.2421ms 4.1314 KOps/s 4.0946 KOps/s $\color{#35bf28}+0.90\%$
test_storage_write_contiguous[100-img_shape2-large_img] 2.1812ms 1.8726ms 534.0059 Ops/s 627.3212 Ops/s $\textbf{\color{#d91a1a}-14.88\%}$
test_storage_write_contiguous[200-img_shape3-large_batch] 1.8168ms 1.4095ms 709.4706 Ops/s 721.5349 Ops/s $\color{#d91a1a}-1.67\%$
test_collector_stack_then_write[50-img_shape0-small] 1.3622ms 1.1561ms 865.0114 Ops/s 854.7678 Ops/s $\color{#35bf28}+1.20\%$
test_collector_stack_then_write[100-img_shape1-atari] 3.8301ms 3.6649ms 272.8597 Ops/s 273.3976 Ops/s $\color{#d91a1a}-0.20\%$
test_collector_stack_then_write[100-img_shape2-large_img] 11.3979ms 5.7764ms 173.1191 Ops/s 170.9205 Ops/s $\color{#35bf28}+1.29\%$
test_collector_stack_then_write[200-img_shape3-large_batch] 7.5743ms 7.1671ms 139.5261 Ops/s 133.9856 Ops/s $\color{#35bf28}+4.14\%$
test_collector_lazystack_then_write[50-img_shape0-small] 0.4455ms 0.2743ms 3.6457 KOps/s 3.5767 KOps/s $\color{#35bf28}+1.93\%$
test_collector_lazystack_then_write[100-img_shape1-atari] 1.6657ms 1.5432ms 648.0250 Ops/s 644.8710 Ops/s $\color{#35bf28}+0.49\%$
test_collector_lazystack_then_write[100-img_shape2-large_img] 2.8179ms 2.4191ms 413.3744 Ops/s 406.5010 Ops/s $\color{#35bf28}+1.69\%$
test_collector_lazystack_then_write[200-img_shape3-large_batch] 3.4014ms 3.1167ms 320.8557 Ops/s 308.5309 Ops/s $\color{#35bf28}+3.99\%$
test_collector_without_rb[100-img_shape0-atari] 33.3752ms 32.4498ms 30.8168 Ops/s 30.2912 Ops/s $\color{#35bf28}+1.73\%$
test_collector_without_rb[200-img_shape1-large_batch] 64.3734ms 63.6611ms 15.7082 Ops/s 15.3511 Ops/s $\color{#35bf28}+2.33\%$
test_collector_with_rb[100-img_shape0-atari] 37.5216ms 37.0057ms 27.0229 Ops/s 26.4803 Ops/s $\color{#35bf28}+2.05\%$
test_collector_with_rb[200-img_shape1-large_batch] 73.0967ms 72.4151ms 13.8093 Ops/s 13.5204 Ops/s $\color{#35bf28}+2.14\%$
test_collector_without_rb_cuda[100-img_shape0-atari] 56.0139ms 55.3201ms 18.0766 Ops/s 17.7863 Ops/s $\color{#35bf28}+1.63\%$
test_collector_without_rb_cuda[200-img_shape1-large_batch] 0.1108s 0.1102s 9.0745 Ops/s 8.9773 Ops/s $\color{#35bf28}+1.08\%$
test_collector_with_rb_cuda[100-img_shape0-atari] 58.6972ms 57.3445ms 17.4385 Ops/s 17.2302 Ops/s $\color{#35bf28}+1.21\%$
test_collector_with_rb_cuda[200-img_shape1-large_batch] 0.1161s 0.1140s 8.7750 Ops/s 8.6127 Ops/s $\color{#35bf28}+1.88\%$

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

CI Has to do with CI setup (e.g. wheels & builds, tests...) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. Environments Adds or modifies an environment wrapper

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@vmoens