Skip to content
@mbzuai-oryx

ORYX

A Library for Large Vision-Language Models

Popular repositories Loading

  1. Video-ChatGPT Video-ChatGPT Public

    [ACL 2024 🔥] Video-ChatGPT is a video conversation model capable of generating meaningful conversation about videos. It combines the capabilities of LLMs with a pretrained visual encoder adapted fo…

    Python 1.3k 110

  2. LLaVA-pp LLaVA-pp Public

    🔥🔥 LLaVA++: Extending LLaVA with Phi-3 and LLaMA-3 (LLaVA LLaMA-3, LLaVA Phi-3)

    Python 818 61

  3. groundingLMM groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    Python 797 38

  4. MobiLlama MobiLlama Public

    MobiLlama : Small Language Model tailored for edge devices

    Python 614 47

  5. XrayGPT XrayGPT Public

    [BIONLP@ACL 2024] XrayGPT: Chest Radiographs Summarization using Medical Vision-Language Models.

    Python 478 57

  6. GeoChat GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    Python 474 38

Repositories

Showing 10 of 18 repositories
  • UniMed-CLIP Public

    Official repository of paper titled "UniMed-CLIP: Towards a Unified Image-Text Pretraining Paradigm for Diverse Medical Imaging Modalities".

    mbzuai-oryx/UniMed-CLIP’s past year of commit activity
    Python 50 0 0 0 Updated Dec 21, 2024
  • BiMediX2 Public

    Bio-Medical EXpert LMM with English and Arabic Language Capabilities

    mbzuai-oryx/BiMediX2’s past year of commit activity
    50 5 0 0 Updated Dec 15, 2024
  • VideoGLaMM Public

    A Large Multimodal Model for Pixel-Level Visual Grounding in Videos

    mbzuai-oryx/VideoGLaMM’s past year of commit activity
    37 0 3 0 Updated Dec 13, 2024
  • Camel-Bench Public

    CAMEL-Bench is an Arabic benchmark for evaluating multimodal models across eight domains with 29,000 questions.

    mbzuai-oryx/Camel-Bench’s past year of commit activity
    Python 30 MIT 1 0 0 Updated Dec 12, 2024
  • ALM-Bench Public

    🔥 ALM-Bench is a multilingual multi-modal diverse cultural benchmark for 100 languages across 19 categories. It assesses the next generation of LMMs on cultural inclusitivity.

    mbzuai-oryx/ALM-Bench’s past year of commit activity
    Python 27 1 0 0 Updated Nov 29, 2024
  • GeoChat Public

    [CVPR 2024 🔥] GeoChat, the first grounded Large Vision Language Model for Remote Sensing

    mbzuai-oryx/GeoChat’s past year of commit activity
    Python 474 38 32 1 Updated Nov 28, 2024
  • BiMediX Public

    Bilingual Medical Mixture of Experts LLM

    mbzuai-oryx/BiMediX’s past year of commit activity
    28 1 1 0 Updated Nov 23, 2024
  • groundingLMM Public

    [CVPR 2024 🔥] Grounding Large Multimodal Model (GLaMM), the first-of-its-kind model capable of generating natural language responses that are seamlessly integrated with object segmentation masks.

    mbzuai-oryx/groundingLMM’s past year of commit activity
    Python 797 38 26 0 Updated Nov 23, 2024
  • ClimateGPT Public

    [EMNLP'23] ClimateGPT: a specialized LLM for conversations related to Climate Change and Sustainability topics in both English and Arabic languages.

    mbzuai-oryx/ClimateGPT’s past year of commit activity
    Python 78 10 0 0 Updated Sep 24, 2024
  • PALO Public

    (WACV 2025) Vision-language conversation in 10 languages including English, Chinese, French, Spanish, Russian, Japanese, Arabic, Hindi, Bengali and Urdu.

    mbzuai-oryx/PALO’s past year of commit activity
    Python 81 Apache-2.0 5 5 0 Updated Sep 10, 2024
View all repositories

Top languages

Loading…