Skip to content

Commit 902fa0e

Browse files
tifchen-nvdahougantc-nvda
authored andcommitted
Updates cloudxr teleop known issue documentation (isaac-sim#3639)
# Description Updates cloudxr teleop doc to address: - [[VDR][Isaac Lab][2.2] HW and SW compatibility requirements at the top](https://nvbugswb.nvidia.com/NVBugs5/redir.aspx?url=/5460521) - [[VDR][Isaac Lab][2.2] Collecting human demonstrations in VR still presents a learning curve](https://nvbugswb.nvidia.com/NVBugs5/redir.aspx?url=/5460510) - [[Isaac-Sim 5.0 rc8][Isaac-Lab 2.2 internal][Mimic] XR_ERROR_INSTANCE_LOST in xrPollEvent](https://nvbugswb.nvidia.com/NVBugs5/redir.aspx?url=/5305422) - `NV_GPU_INDEX` issues ## Type of change - Documentation update ## Checklist - [x] I have read and understood the [contribution guidelines](https://isaac-sim.github.io/IsaacLab/main/source/refs/contributing.html) - [x] I have run the [`pre-commit` checks](https://pre-commit.com/) with `./isaaclab.sh --format` - [x] I have made corresponding changes to the documentation - [ ] My changes generate no new warnings - [ ] I have added tests that prove my fix is effective or that my feature works - [ ] I have updated the changelog and the corresponding version in the extension's `config/extension.toml` file - [x] I have added my name to the `CONTRIBUTORS.md` or my name already exists there
1 parent df76229 commit 902fa0e

File tree

2 files changed

+21
-12
lines changed

2 files changed

+21
-12
lines changed

docs/source/how-to/cloudxr_teleoperation.rst

Lines changed: 20 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -63,16 +63,13 @@ Prior to using CloudXR with Isaac Lab, please review the following system requir
6363
* Isaac Lab workstation
6464

6565
* Ubuntu 22.04 or Ubuntu 24.04
66+
* Hardware requirements to sustain 45 FPS with a 120Hz physics simulation:
67+
* CPU: 16-Cores AMD Ryzen Threadripper Pro 5955WX or higher
68+
* Memory: 64GB RAM
69+
* GPU: 1x RTX PRO 6000 GPUs (or equivalent e.g. 1x RTX 5090) or higher
70+
* For details on driver requirements, please see the `Technical Requirements <https://docs.omniverse.nvidia.com/materials-and-rendering/latest/common/technical-requirements.html>`_ guide
6671
* `Docker`_ 26.0.0+, `Docker Compose`_ 2.25.0+, and the `NVIDIA Container Toolkit`_. Refer to
6772
the Isaac Lab :ref:`deployment-docker` for how to install.
68-
* For details on driver requirements, please see the `Technical Requirements <https://docs.omniverse.nvidia.com/materials-and-rendering/latest/common/technical-requirements.html>`_ guide
69-
* CPU
70-
* Intel: 16-core Intel Core i9, X-series or higher
71-
* AMD: Ryzen 9 5900XT, Ryzen Threadripper PRO 5955WX or higher
72-
* Memory: 64GB RAM
73-
* GPU
74-
* Minimum: 1x RTX PRO 6000 GPUs (or equivalent e.g. 1x RTX 5090)
75-
* Recommended: 2x RTX PRO 6000 GPUs (or equivalent e.g. 2x RTX 5090)
7673

7774
* Apple Vision Pro
7875

@@ -282,11 +279,11 @@ On your Mac:
282279
+-------------------+---------------------+
283280
| Isaac Lab Version | Client App Version |
284281
+-------------------+---------------------+
285-
| 2.3.x | v2.3.0 |
282+
| 2.3 | v2.3.0 |
286283
+-------------------+---------------------+
287-
| 2.2.x | v2.2.0 |
284+
| 2.2 | v2.2.0 |
288285
+-------------------+---------------------+
289-
| 2.1.x | v1.0.0 |
286+
| 2.1 | v1.0.0 |
290287
+-------------------+---------------------+
291288

292289
.. code-block:: bash
@@ -988,6 +985,11 @@ Known Issues
988985
This error message can be safely ignored. It is caused by a race condition in the exit handler for
989986
AR Mode.
990987

988+
* ``XR_ERROR_INSTANCE_LOST in xrPollEvent: Call to "xrt_session_poll_events" failed``
989+
990+
This error may occur if the CloudXR runtime exits before Isaac Lab. Restart the CloudXR
991+
runtime to resume teleoperation.
992+
991993
* ``[omni.usd] TF_PYTHON_EXCEPTION`` when starting/stopping AR Mode
992994

993995
This error message can be safely ignored. It is caused by a race condition in the enter/exit
@@ -998,6 +1000,13 @@ Known Issues
9981000
This error message can be caused by shader assets authored with older versions of USD, and can
9991001
typically be ignored.
10001002

1003+
* The XR device connects successfully, but no video is displayed, even though the Isaac Lab viewport responds to tracking.
1004+
1005+
This error occurs when the GPU index differs between the host and the container, causing CUDA
1006+
to load on the wrong GPU. To fix this, set ``NV_GPU_INDEX`` in the runtime container to ``0``, ``1``,
1007+
or ``2`` to ensure the GPU selected by CUDA matches the host.
1008+
1009+
10011010
Kubernetes Deployment
10021011
---------------------
10031012

docs/source/overview/imitation-learning/teleop_imitation.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -61,7 +61,7 @@ For tasks that benefit from the use of an extended reality (XR) device with hand
6161
6262
.. note::
6363

64-
See :ref:`cloudxr-teleoperation` to learn more about using CloudXR with Isaac Lab.
64+
See :ref:`cloudxr-teleoperation` to learn how to use CloudXR and experience teleoperation with Isaac Lab.
6565

6666

6767
The script prints the teleoperation events configured. For keyboard,

0 commit comments

Comments
 (0)