Skip to content

feat: support multi-model chat #7302

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
onyxtrialee3 wants to merge 7 commits into
base: main
Choose a base branch
from
+2,144 −146
Draft

feat: support multi-model chat #7302

Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
7 commits
Select commit Hold shift + click to select a range
997bfad
feat: support multi-model chat from backend
XueTang422 Jan 9, 2026
a985056
Merge branch 'main' into sophia/enable-multi-model-chat
onyxtrialee3 Jan 9, 2026
32238fa
feat: support multi model from frontend
XueTang422 Jan 9, 2026
cf7eacb
Merge remote-tracking branch 'refs/remotes/origin/sophia/enable-multi…
XueTang422 Jan 9, 2026
1e95e43
feat: enable proper highlight and message selection
XueTang422 Jan 9, 2026
9a671dd
feat: enable response streaming
XueTang422 Jan 9, 2026
ec1f0a4
feat: edit message should remember model selection
XueTang422 Jan 9, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 9 additions & 0 deletions backend/onyx/chat/models.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -102,6 +102,14 @@ class MessageResponseIDInfo(BaseModel):
reserved_assistant_message_id: int


class MultiModelMessageResponseIDInfo(BaseModel):
"""Response info for multi-model chat: one user message, multiple assistant messages."""

user_message_id: int | None
reserved_assistant_message_ids: list[int] # One per model
model_names: list[str] # Display names for UI


class StreamingError(BaseModel):
error: str
stack_trace: str | None = None
Expand Down Expand Up @@ -200,6 +208,7 @@ class LLMMetricsContainer(BaseModel):
Packet
| StreamStopInfo
| MessageResponseIDInfo
| MultiModelMessageResponseIDInfo
| StreamingError
| UserKnowledgeFilePacket
| CreateChatSessionID
Expand Down
Loading
Loading