IDEA-Research

All

44 repositories

detrex
Public
detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.
segmentation pose-estimation dino state-of-the-art deta detr deformable-detr dab-detr mask-dino dn-detr
Python
•
Apache License 2.0
•233•2.2k•79•4•Updated Sep 6, 2025Sep 6, 2025
Grounded-SAM-2
Public
Grounded SAM 2: Ground and Track Anything in Videos with Grounding DINO, Florence-2 and SAM 2
Jupyter Notebook
•
Apache License 2.0
•299•2.7k•45•3•Updated Aug 20, 2025Aug 20, 2025
DINO-X-MCP
Public
Official DINO-X Model Context Protocol (MCP) server that empowers LLMs with real-world visual perception through image object detection, localization, and captioning APIs.
mcp image-recognition object-detection pose-estimation mcp-server
TypeScript
•
Apache License 2.0
•6•52•0•1•Updated Aug 8, 2025Aug 8, 2025
T-Rex
Public
[ECCV2024] API code for T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergy
interactive object-detection open-set object-counting text-prompt visual-prompt
Python
•
Other
•168•2.6k•13•0•Updated Aug 4, 2025Aug 4, 2025
DINO-X-API
Public
DINO-X: The World's Top-Performing Vision Model for Open-World Object Detection and Understanding
pose-estimation open-set-object-detection visual-prompt region-caption open-set-object-segmentation
Python
•
Apache License 2.0
•49•1.2k•32•1•Updated Jul 23, 2025Jul 23, 2025
Rex-Thinker
Public
Rex-Thinker: Grounded Object Refering via Chain-of-Thought Reasoning
object-detection referring-expression-comprehension mllm grpo
Python
•
Other
•6•116•9•1•Updated Jun 30, 2025Jun 30, 2025
RexSeek
Public
[ICCV2025] Referring any person or objects given a natural language description. Code base for RexSeek and HumanRef Benchmark
detection multi-modal open-set referring llm vllm
Python
•
Other
•10•157•0•0•Updated Apr 14, 2025Apr 14, 2025
3D-deformable-attention
Public
[ICCV 2023] Official implementation of the paper "DFA3D: 3D Deformable Attention For 2D-to-3D Feature Lifting"
Python
•
Other
•5•167•1•0•Updated Apr 12, 2025Apr 12, 2025
HandOSweb
Public
HTML
•0•1•0•0•Updated Mar 19, 2025Mar 19, 2025
Motion-X
Public
[NeurIPS 2023] Official implementation of the paper "Motion-X: A Large-scale 3D Expressive Whole-body Human Motion Dataset"
Python
•
Other
•23•745•79•0•Updated Mar 3, 2025Mar 3, 2025
ChatRex
Public
Code for ChatRex: Taming Multimodal LLM for Joint Perception and Understanding
detection vlm multimodal-deep-learning llm mllm
Python
•
Other
•7•202•10•0•Updated Jan 24, 2025Jan 24, 2025
Grounding-DINO-1.5-API
Public
Grounding DINO 1.5: IDEA Research's Most Capable Open-World Object Detection Model Series
open-world object-detection open-set zero-shot-object-detection foundation-model open-vocabulary-detection grounding-dino
Python
•
Apache License 2.0
•40•1k•34•1•Updated Jan 21, 2025Jan 21, 2025
TAPTR
Public
[ECCV 2024 & NeurIPS 2024] Official implementation of the paper TAPTR & TAPTRv2 & TAPTRv3
Other
•13•266•1•0•Updated Dec 13, 2024Dec 13, 2024
MotionCLR
Public
[Arxiv 2024] MotionCLR: Motion Generation and Training-free Editing via Understanding Attention Mechanisms
Python
•
Other
•1•12•6•0•Updated Dec 1, 2024Dec 1, 2024
detrex-storage
Public
Apache License 2.0
•0•3•0•0•Updated Oct 24, 2024Oct 24, 2024
DreamWaltz
Public
[NeurIPS 2023] Official implementation of the paper "DreamWaltz: Make a Scene with Complex 3D Animatable Avatars".
Python
•
Other
•10•189•1•0•Updated Oct 15, 2024Oct 15, 2024
MotionLLM
Public
[Arxiv-2024] MotionLLM: Understanding Human Behaviors from Human Motions and Videos
Python
•
Other
•15•348•7•1•Updated Sep 8, 2024Sep 8, 2024
Grounded-Segment-Anything
Public
Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything
speech image-editing caption data-generation 3d-whole-body-pose-estimation open-vocabulary-detection open-vocabulary-segmentation automatic-labeling-system
Jupyter Notebook
•
Apache License 2.0
•1.5k•17k•301•4•Updated Sep 5, 2024Sep 5, 2024
OSX
Public
[CVPR 2023] Official implementation of the paper "One-Stage 3D Whole-Body Mesh Recovery with Component Aware Transformer"
human-pose-estimation smpl-model smplx 3d-body-recovery whole-body-pose-estimation cvpr2023
Python
•
MIT License
•60•740•33•0•Updated Aug 26, 2024Aug 26, 2024
X-Pose
Public
[ECCV 2024] Official implementation of the paper "X-Pose: Detecting Any Keypoints"
Python
•
Other
•37•716•33•2•Updated Aug 16, 2024Aug 16, 2024
GroundingDINO
Public
[ECCV 2024] Official implementation of the paper "Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detection"
open-world object-detection vision-language vision-language-transformer open-world-detection
Python
•
Apache License 2.0
•905•8.9k•284•26•Updated Aug 12, 2024Aug 12, 2024
DINO
Public
[ICLR 2023] Official implementation of the paper "DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detection"
computer-vision deep-learning object-detection
Python
•
Apache License 2.0
•291•2.6k•149•3•Updated Jul 31, 2024Jul 31, 2024
awesome-detection-transformer
Public
Collect some papers about transformer for detection and segmentation. Awesome Detection Transformer for Computer Vision (CV)
118•1.4k•7•1•Updated Jul 4, 2024Jul 4, 2024
HumanTOMATO
Public
[ICML 2024] 🍅HumanTOMATO: Text-aligned Whole-body Motion Generation
motion generation gpt whole-body smplx motion-generation whole-body-motion
Python
•
Other
•9•345•20•0•Updated Jun 19, 2024Jun 19, 2024
TOSS
Public
[ICLR 2024] Official implementation of the paper "Toss: High-quality text-guided novel view synthesis from a single image"
open-world 3d-generation novel-view-synthesis
Python
•
Apache License 2.0
•2•22•0•0•Updated May 5, 2024May 5, 2024
Stable-DINO
Public
[ICCV 2023] Official implementation of the paper "Detection Transformer with Stable Matching"
transformer object-detection dino detection-transformer detrex
Python
•
Apache License 2.0
•7•232•20•0•Updated Apr 29, 2024Apr 29, 2024
deepdataspace
Public
The Go-To Choice for CV Data Visualization, Annotation, and Model Analysis.
computer-vision model-analysis labeling-tool dataset-visualization intelligent-annotation collaborative-annotation
TypeScript
•
Apache License 2.0
•25•259•6•0•Updated Apr 19, 2024Apr 19, 2024
IYFC
Public
C++
•1•9•0•0•Updated Feb 19, 2024Feb 19, 2024
OpenSeeD
Public
[ICCV 2023] Official implementation of the paper "A Simple Framework for Open-Vocabulary Segmentation and Detection"
Python
•
Apache License 2.0
•46•729•20•1•Updated Jan 22, 2024Jan 22, 2024
DN-DETR
Public
[CVPR 2022 Oral] Official implementation of DN-DETR
object-detection detr
Python
•
Apache License 2.0
•67•587•36•1•Updated Dec 20, 2023Dec 20, 2023