Skip to content

Claude/add cpu mps support p6 mzo #375

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
eleviidev wants to merge 46 commits into from
Closed

Claude/add cpu mps support p6 mzo #375

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
46 commits
Select commit Hold shift + click to select a range
96540b7
Add CPU and MPS (Apple Silicon) support for non-CUDA environments
claude Dec 22, 2025
d19c6b7
Add tests for CPU and MPS device support
claude Dec 22, 2025
e0eceaf
Add live camera segmentation example with CPU/MPS support
claude Dec 22, 2025
4a4742d
Make decord import lazy to fix ModuleNotFoundError
claude Dec 23, 2025
a7b0afb
Fix hardcoded CUDA device references for CPU/MPS compatibility
claude Dec 23, 2025
66c836f
Fix live camera script to use Sam3Processor API
claude Dec 23, 2025
13e7af4
Add MPS-safe wrapper for grid_sample to fix Apple Silicon
claude Dec 23, 2025
cabc154
Fix pin_memory() calls for MPS compatibility
claude Dec 23, 2025
9e8bdc1
Fix _assert_async for MPS compatibility
claude Dec 23, 2025
9248193
Add performance options for live camera on slower devices
claude Dec 23, 2025
bee5e0a
Remove resolution option - model requires fixed 1008 resolution
claude Dec 23, 2025
91ead6f
Add half precision option for faster inference on MPS
claude Dec 23, 2025
250cb5d
Fix half precision by matching input dtype to model dtype
claude Dec 23, 2025
d5451f8
Fix roi_align dtype mismatch for half precision
claude Dec 23, 2025
0b07e55
Disable half precision on MPS - Metal doesn't support mixed precision
claude Dec 23, 2025
f822650
Add mask tracking between skipped frames for smoother live camera output
claude Dec 23, 2025
2d23549
Fix tracker to use local sam3.pt checkpoint instead of HuggingFace do…
claude Dec 23, 2025
9b3fca5
Add examples/ folder to checkpoint search paths for tracker
claude Dec 23, 2025
c0418e5
Fix tracker mask addition - add frame image before adding mask
claude Dec 23, 2025
f20b3ba
Fix mask dtype - convert bool to float before interpolation
claude Dec 23, 2025
7d75041
Keep tracker state on device to avoid MPS/CPU mismatch
claude Dec 23, 2025
7185152
Simplify tracking for MPS compatibility - reuse masks between keyframes
claude Dec 23, 2025
4ce6f9e
Add optical flow based tracking between keyframes for MPS compatibility
claude Dec 23, 2025
6511386
Add labels, confidence scores, and object info panel to live camera
claude Dec 23, 2025
9a000cb
Add multi-prompt detection support for detecting multiple object types
claude Dec 23, 2025
8ea92cc
Update project title to include MPS/CPU support
eleviidev Dec 23, 2025
148ffa9
Add Flask-based web command center for SAM3
claude Dec 23, 2025
cb6faa5
Add MPS (Metal) performance optimizations
claude Dec 23, 2025
349611e
Add advanced SAM3 features with toggle controls
claude Dec 24, 2025
07d3724
Add YOLOv12 integration for classification and pose estimation
claude Dec 24, 2025
08e6550
Add voice-to-AI search with Claude parsing and TTS feedback
claude Dec 24, 2025
2c4c88e
Add camera selection dropdown and flip/mirror controls
claude Dec 24, 2025
44cb8b7
Fix object persistence in detected objects panel during tracking
claude Dec 24, 2025
9c8fa4a
Add proper Anthropic API key handling
claude Dec 25, 2025
484ca52
Fix YOLO model names - use YOLO11 (latest) with v8 fallback
claude Dec 25, 2025
c9652f8
Try YOLO12 first with fallback chain to YOLO11 and YOLOv8
claude Dec 25, 2025
650b2b6
Fix Claude analysis to use raw frame without overlays
claude Dec 25, 2025
e343616
Add mask-based cropping, describe scene, voice describe, and HTTPS
claude Dec 25, 2025
499c99f
Add reference image search and draw-to-search features
claude Dec 25, 2025
015ee2c
Add navigation system for visually impaired users
claude Dec 25, 2025
f45d46b
Add SQLite database, obstacle detection, and post-navigation dialog
claude Dec 25, 2025
56514ef
Replace static obstacle detection with Claude AI-powered analysis
claude Dec 25, 2025
54f142a
Add hybrid obstacle detection: OpenCV (fast) + Claude AI (smart)
claude Dec 25, 2025
00514c1
Add proprietary 4-layer obstacle detection with monocular depth
claude Dec 25, 2025
38927e7
Add AR navigation path visualization system
claude Dec 25, 2025
7f7e6dd
Fix AR navigation frontend-backend integration issues
claude Dec 25, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,4 +1,4 @@
# SAM 3: Segment Anything with Concepts
# SAM 3: Segment Anything with Concepts WITH MPS/CPU SUPPORT FOR APPLE METAL

Meta Superintelligence Labs

Expand Down
Loading