You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit daf3899
Browse filesBrowse the repository at this point in the historyBrowse files
@@ -29,17 +29,19 @@ This is the codebase for the **GR00T Whole-Body Control (WBC)** projects. It hos
29
29
30
30
## News
31
31
32
-
-**[2026-03-24]** Update the C++ inference stack: motor error monitoring and temperature reporting (with TTS alerts and MuJoCo heatmap visualization); support streamed token input via ZMQ protocol v4; idle-mode error-based readaptation; TRT engine output now co-located with ONNX model; **ZMQ header size changed to 1280 bytes**
33
-
-**[2026-03-16]**[BONES-SEED](https://huggingface.co/datasets/bones-studio/seed) is now open-sourced! A large-scale human motion dataset (142K+ motions, ~288 hours) with Unitree G1 MuJoCo-compatible trajectories (a large subset of SONIC training data!).
34
-
-**[2026-02-19]** Released GEAR-SONIC with pretrained policy checkpoints, C++ inference stack, VR teleoperation stack, and documentation.
35
-
-**[2025-11-12]** Initial release of GR00T-WholeBodyControl with Decoupled WBC for GR00T N1.5 and N1.6.
32
+
-**[2026-04-10]** Released SONIC training code, checkpoint, and SMPL data on [HuggingFace](https://huggingface.co/nvidia/GEAR-SONIC). Train from scratch or finetune. Added support for additional embodiments. See [Training Guide](https://nvlabs.github.io/GR00T-WholeBodyControl/user_guide/training.html).
33
+
-**[2026-03-24]** C++ inference stack update: motor error monitoring, TTS alerts, ZMQ protocol v4, idle-mode readaptation. **ZMQ header size changed to 1280 bytes.**
34
+
-**[2026-03-16]**[BONES-SEED](https://huggingface.co/datasets/bones-studio/seed) open-sourced — 142K+ human motions (~288 hours) with G1 MuJoCo trajectories.
35
+
-**[2026-02-19]** Released GEAR-SONIC: pretrained checkpoints, C++ inference, VR teleoperation, and documentation.
36
+
-**[2025-11-12]** Initial release with Decoupled WBC for GR00T N1.5 and N1.6.
@@ -66,7 +68,7 @@ This is the codebase for the **GR00T Whole-Body Control (WBC)** projects. It hos
66
68
67
69
SONIC is a humanoid behavior foundation model that gives robots a core set of motor skills learned from large-scale human motion data. Rather than building separate controllers for predefined motions, SONIC uses motion tracking as a scalable training task, enabling a single unified policy to produce natural, whole-body movement and support a wide range of behaviors — from walking and crawling to teleoperation and multi-modal control. It is designed to generalize beyond the motions it has seen during training and to serve as a foundation for higher-level planning and interaction.
68
70
69
-
In this repo, we will release SONIC's training code, deployment framework, model checkpoints, and teleoperation stack for data collection.
71
+
In this repo, we release SONIC's training code, deployment framework, model checkpoints, and teleoperation stack for data collection.
70
72
71
73
72
74
## VR Whole-Body Teleoperation
@@ -157,13 +159,50 @@ SONIC includes a kinematic planner for real-time locomotion generation — choos
157
159
</table>
158
160
</div>
159
161
162
+
## SONIC Training
163
+
164
+
SONIC can be trained from scratch on the [Bones-SEED](https://huggingface.co/datasets/bones-studio/seed)
-[x] Open source teleoperation stack and demonstration scripts
166
-
-[] Release training scripts and recipes for motion imitation and fine-tuning
205
+
-[x] Release training scripts and recipes for motion imitation and fine-tuning
167
206
-[ ] Open source large-scale data collection workflows and fine-tuning VLA scripts.
168
207
-[ ] Publish additional preprocessed large-scale human motion datasets
169
208
@@ -174,17 +213,38 @@ SONIC includes a kinematic planner for real-time locomotion generation — choos
174
213
This release includes:
175
214
176
215
-**`gear_sonic_deploy`**: C++ inference stack for deploying SONIC policies on real hardware
177
-
-**`gear_sonic`**: Teleoperation stack for collecting demonstration data (no training code, YET.)
216
+
-**`gear_sonic`**: Full SONIC training stack — PPO training, data processing pipeline, and configuration system for training on Bones-SEED and custom motion datasets
178
217
179
218
### Setup
180
219
181
-
Clone the repository with Git LFS:
220
+
> **Git LFS required.** This repo contains large binary assets (meshes, ONNX
221
+
> models). Without Git LFS, you will get small pointer files instead of actual
222
+
> data, causing silent failures. Install Git LFS first if you don't have it:
|**Deploy on real robot**| C++ build | See [deployment docs](https://nvlabs.github.io/GR00T-WholeBodyControl/getting_started/installation_deploy.html)|
243
+
244
+
Each use case has its own lightweight environment. The install scripts use `uv`
245
+
and create isolated venvs automatically — you don't need to manage them manually.
246
+
Training is the only one that requires Isaac Lab (installed separately).
0 commit comments