Skip to content

Commit 0a48501

Browse files
committed
Updated README
1 parent 953e3cf commit 0a48501

File tree

1 file changed

+22
-2
lines changed

1 file changed

+22
-2
lines changed

README.md

Lines changed: 22 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,29 @@
22

33
[![Github Actions Status](https://github.com/jupyter-ai-contrib/jupyter-ai-litellm/workflows/Build/badge.svg)](https://github.com/jupyter-ai-contrib/jupyter-ai-litellm/actions/workflows/build.yml)
44

5-
A JupyterLab extension that provides LiteLLM model abstraction
5+
A JupyterLab extension that provides LiteLLM model abstraction for Jupyter AI
66

7-
This extension is composed of a Python package named `jupyter_ai_litellm`.
7+
This extension is composed of a Python package named `jupyter_ai_litellm` that exposes LiteLLM's extensive catalog of language models through a standardized API.
8+
9+
## Features
10+
11+
- **Comprehensive Model Support**: Access to hundreds of chat and embedding models from various providers (OpenAI, Anthropic, Google, Cohere, Azure, AWS, and more) through LiteLLM's unified interface
12+
- **Standardized API**: Consistent REST API endpoints for model discovery and interaction
13+
- **Easy Integration**: Seamlessly integrates with Jupyter AI to expand available model options
14+
15+
## API Endpoints
16+
17+
### Chat Models
18+
19+
- `GET /api/models/chat` - Returns a list of all available chat models
20+
21+
The response includes model IDs in LiteLLM format (e.g., `openai/gpt-4`, `anthropic/claude-3-sonnet`, etc.)
22+
23+
### Model Lists
24+
25+
The extension automatically discovers and categorizes models from LiteLLM's supported providers:
26+
- Chat models for conversational AI
27+
- Embedding models for vector representations
828

929
## Requirements
1030

0 commit comments

Comments
 (0)