Workaround for the MCP server connection cleanup issue#57
Workaround for the MCP server connection cleanup issue#57TamiTakamiya wants to merge 1 commit intomainfrom
Conversation
0cb58f3 to
7204b59
Compare
7204b59 to
fa5ab17
Compare
I am currently working on bumping both this repo and lightspeed-stack to 0.5.x which will hopefully be done by Wednesday at the latest. So if you want to wait that could be option... Totally understand if not though :) |
@jrobertboos We (Ansible Lightspeed team) is planning to release our next version based on the coming lightspeed-stack 0.4.2. So we do need to have this workaround for our release. After the lightspeed-providers 0.4.2 is released with this workaround, please update this repo to Llama Stack 0.5.x and take out this workaround. Thanks. |
Description
This is a workaround for the MCP server issue found by @ldjebran while we are working on #52. Refer to this PR comment for more details.
It is required for Llama Stack 0.4.3. We should be able to take this workaround out when we move to Llama Stack 0.5.x.
Type of change
Tools used to create PR
Identify any AI code assistants used in this PR (for transparency and review context)
Related Tickets & Documents
Checklist before requesting a review
Testing
Unit test cases are provided. For manual testing, configure a RAG chatbot with MCP enabled (any MCP server that uses a network connection should be fine) and issue a streaming quey API.
Manual verification can be done using Ansible Lightspeed Intelligent Agent (ALIA) BYOK feature, which are being built using Lightspeed Core Stack 0.4.x + Llama Stack 0.4.3.