Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

streaming support for ReActAgent #794

Closed
tom-leamon opened this issue May 2, 2024 · 3 comments · Fixed by #798
Closed

streaming support for ReActAgent #794

tom-leamon opened this issue May 2, 2024 · 3 comments · Fixed by #798
Labels
bug Something isn't working

Comments

@tom-leamon
Copy link

tom-leamon commented May 2, 2024

Streaming for OpenAIAgent was added by #788. Attempting to use AnthropicAgent results in the error:

Error: Anthropic does not support streaming

This Error message is a little dubious, because it's clear Anthropic does actually support streaming, so I assume this to be a limitation of the current implementation of agent streaming, in which case the error should be:

Error: LlamaIndex does not yet support streaming for AnthropicAgent

Additionally, I attempted to use ReActAgent streaming with Llama3-70B on Groq. The call seemed to just freeze and never return any results.

Non-streaming works properly for both AnthropicAgent and ReActAgent. I would like to clarify if these are just limitations of the current agent streaming abilities, or if it's actually true that this is not possible with Anthropic.

@himself65
Copy link
Member

  1. Anthroipc doesn't support streaming https://docs.anthropic.com/claude/docs/tool-use

@himself65 himself65 added the bug Something isn't working label May 2, 2024
@himself65 himself65 changed the title Add streaming support for ReActAgent and AnthropicAgent streaming support for ReActAgent May 2, 2024
@himself65
Copy link
Member

Thanks for report, seems like there is a bug in ReAct Agent that will exit silently

@himself65
Copy link
Member

himself65 commented May 2, 2024

Seems like a pitfall

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants