Skip to content

Conversation

thucpn
Copy link
Collaborator

@thucpn thucpn commented Jul 28, 2025

Flow:

  • llamaindex-workflow produces events
  • llamaindex-server transform events to SSE
  • vercel/ai computes events to parts (text, weather, sources,...)
  • chat-ui renders parts (texts -> multiple markdown blocks, other parts -> annotation blocks)

Breaking changes:

  • Backend:
    • need data-* prefix for annotations type. eg: 'data-weather'
    • use standard Server-Sent Events
  • Chat-UI contract:
    • reload and append are removed (use regenerate and sendMessage instead)
    • message.content is removed (use message.parts.filter(p => p.type === 'text') instead)
    • message.annotations is removed (use `message.parts.filter(p => p.type !== 'text') instead)
  • Simplify EventPart and FilePart:
    • removed EventAnnotations (type = "events") and AgentEventAnnotations (type = "agent-events"). Instead, I create EventPart (type = "event) that leverage new "part id" feature.
    • removed ImageAnnotations (type = "image") and DocumentFileAnnotations (type = "document-file"). Instead, I create FilePart (type = "file"), it will cover display all file types

Tasks:

  • update ChatHandler contract to work with Vercel AI SDK 5
  • update for ai/rsc
  • update useChatWorkfow
  • update app/web
  • update registry
  • update nextjs example
  • update @llamaindex/server
  • update fastapi example
  • retest llamadeploy example
  • update document

@thucpn thucpn requested a review from marcusschiesser July 28, 2025 08:22
Copy link

changeset-bot bot commented Jul 28, 2025

🦋 Changeset detected

Latest commit: 7ac96ac

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 6 packages
Name Type
@llamaindex/chat-ui Minor
@llamaindex/server Minor
llamaindex-server-examples Patch
web Patch
@llamaindex/chat-ui-docs Patch
@llamaindex/dynamic-ui Major

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link

vercel bot commented Jul 28, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Project Deployment Preview Comments Updated (UTC)
chat-ui-web Ready Preview 💬 Add feedback Aug 12, 2025 8:41am

@marcusschiesser marcusschiesser merged commit 1ceb4ba into main Aug 13, 2025
3 checks passed
@marcusschiesser marcusschiesser deleted the tp/support-ai-v5 branch August 13, 2025 03:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants