You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I would like to implement a RAG application using the ReAct agent.
Suppose we have, for example, 5 tools that are used by the agent. If the agent runs multiple reasoning steps, the latency for the final generated response could be very high.
Let's assume we have optimized all of our tools to be as fast as possible, but since the final generation process is very complex, the user might become bored due to the response time.
I was wondering: Is there a way to stream the actions that the agent is performing to generate a final answer to the user?
Example:
User sends a query.
Agent: trying to retrieve info from tool1.
Agent: now I will retrieve info from tool2 based on the context retrieved from tool1.
Agent: I don’t have enough information to give a response. Trying to fetch from tool3.
Agent: final response.
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi folks,
I would like to implement a RAG application using the ReAct agent.
Suppose we have, for example, 5 tools that are used by the agent. If the agent runs multiple reasoning steps, the latency for the final generated response could be very high.
Let's assume we have optimized all of our tools to be as fast as possible, but since the final generation process is very complex, the user might become bored due to the response time.
I was wondering: Is there a way to stream the actions that the agent is performing to generate a final answer to the user?
Example:
User sends a query.
Agent: trying to retrieve info from tool1.
Agent: now I will retrieve info from tool2 based on the context retrieved from tool1.
Agent: I don’t have enough information to give a response. Trying to fetch from tool3.
Agent: final response.
Beta Was this translation helpful? Give feedback.
All reactions