Skip to content

Conversation

@KimMyeongSeop
Copy link

@KimMyeongSeop KimMyeongSeop commented Dec 17, 2025

No description provided.

Added the official research proposal (v3) for developing medical motion
content generation and augmentation technology for Physical AI training.
This document outlines the 4-year project plan using NVIDIA ecosystem
(MONAI, Isaac Sim, ORBIT-Surgical, Isaac Lab).
Created comprehensive project structure for medical Physical AI research:

Project Structure:
- docs/: Research proposal and technical documentation
- data/: Raw, processed, and synthetic data directories
- src/: Source code organized by functionality
  - data/: Data processing and loading
  - generation/: MONAI, MAISI, Cosmos models
  - simulation/: ORBIT-Surgical, Isaac Sim integration
  - training/: Isaac Lab, LeRobot frameworks
  - evaluation/: Metrics (FVD, RMSE) and validation
- notebooks/: Jupyter notebooks for experimentation
- scripts/: Utility scripts including dataset downloaders
- configs/: Configuration files
- experiments/: Experiment logs and results

Key Additions:
1. Dataset documentation (JIGSAWS, Cholec80, EndoVis)
2. Download script for surgical video datasets
3. Requirements.txt with full dependency stack
4. PoC notebook for MONAI Generative Models testing

Technical Stack:
- MONAI Generative Models for video generation
- MAISI for CT synthesis
- ORBIT-Surgical for surgical robot simulation
- Isaac Lab + LeRobot for robot learning

Next Steps:
- Download JIGSAWS dataset
- Run PoC notebook to validate video generation
- Setup ORBIT-Surgical environment
@coderabbitai
Copy link
Contributor

coderabbitai bot commented Dec 17, 2025

Caution

Review failed

The pull request is closed.

Walkthrough

This PR introduces foundational project infrastructure for Physical AI Research. It adds a README outlining project overview and objectives, a technical document cataloging open-source surgical video datasets, a Jupyter notebook demonstrating MONAI generative model workflows (2D/3D diffusion pipelines), a complete Python requirements specification, and a command-line utility script for downloading surgical datasets (JIGSAWS, Cholec80) with structured directory scaffolding and metadata generation.

Estimated code review effort

🎯 3 (Moderate) | ⏱️ ~25 minutes

  • download\_datasets.py: Review DatasetDownloader class design, method signatures, file I/O operations, and CLI argument handling for correctness and usability
  • 02\_monai\_generation\_test.ipynb: Verify MONAI model initialization, diffusion sampling logic, shape correctness, and visualization code validity
  • requirements.txt: Check for version conflicts, validate package names and external Git references
  • open\_source\_datasets.md: Validate dataset descriptions and PoC prioritization accuracy
  • README.md: Confirm project structure documentation aligns with actual repository layout
✨ Finishing touches
  • 📝 Generate docstrings
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Post copyable unit tests in a comment

📜 Recent review details

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Cache: Disabled due to data retention organization setting

Knowledge base: Disabled due to Reviews -> Disable Knowledge Base setting

📥 Commits

Reviewing files that changed from the base of the PR and between 15fd428 and a2fdb33.

⛔ Files ignored due to path filters (1)
  • physical-ai-research/docs/research_proposal.pdf is excluded by !**/*.pdf
📒 Files selected for processing (5)
  • physical-ai-research/README.md (1 hunks)
  • physical-ai-research/docs/technical/open_source_datasets.md (1 hunks)
  • physical-ai-research/notebooks/02_monai_generation_test.ipynb (1 hunks)
  • physical-ai-research/requirements.txt (1 hunks)
  • physical-ai-research/scripts/download_datasets.py (1 hunks)

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants