Skip to content

Conversation

@marcelklehr
Copy link
Member

@marcelklehr marcelklehr commented Dec 9, 2025

  • Remains backward compatible in reading old tokens, new tokens can not be read by old versions of this app (@janepie please test this part again, so we are doubly certain)

  • Previously:

    • 1 Byte of ChatWithTools task size would translate to ~56Bytes of ContextChatInteraction task size
    • A ChatWithTools task of size 32KB would be accompanied by a ContextChatInteraction task of Size 1.8MB
  • Now:

    • 1Byte of chatwithtools task size would translate to ~2.6Bytes of ContextChatInteraction task size
    • A ChatWithTools task of size 32KB would be accompanied by a ContextChatInteraction task of Size 84KB
  • We should still increase the limit in the server repo to maybe 500KB -- that would give space for ~200 messages per chat, if my calculation is correct.

fixes #91

remains backward compatible in reading old tokens, new tokens can not be read by old versions of this app
Signed-off-by: Marcel Klehr <[email protected]>
"""
c = checkpoint.copy()
c.pop("pending_sends") # type: ignore[misc]
#c.pop("pending_sends") # type: ignore[misc]
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pending_sends seems to no longer be part of the checkpoints in langgraph

python = "^3.10"
nc-py-api = {extras = ["calendar"], version = "^0.22.0"}
langgraph = "^0.4.1"
langgraph = "1.*"
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated langgraph while we're at it to be on the stable version 🎉

Copy link
Member

@julien-nc julien-nc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good and clear!

@marcelklehr marcelklehr merged commit 86d9917 into main Dec 15, 2025
3 of 5 checks passed
@marcelklehr marcelklehr deleted the fix/token-size branch December 15, 2025 13:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

text too long

3 participants