Skip to content

[Enhancement]: Summarization of older user context #11121

@vaibhav-Singh9888

Description

@vaibhav-Singh9888

What features would you like to see added?

From my understanding of the current architecture, all LLM interactions are now routed exclusively through the agents pipeline. At the moment, there does not appear to be a built-in summarization mechanism available within agents.

Previously, I had implemented a summarization factory method that delegated to the underlying client implementations (e.g., OpenAI client, Google client). In practice, only the OpenAI summarization path was implemented in the repository, but this was sufficient for my use case.

Recently, the legacy summarization-related code has been removed, which has caused the factory-based summarization approach to break. As a result, there is currently no supported way to perform message or context summarization when using agents.

Impact: Summarization is a critical requirement for my use case, primarily to:

  1. Manage long conversations / context windows
  2. Prevent token overflows
  3. Ensure correctness when historical context must be condensed

Without summarization support in the agents flow, it becomes difficult to use agents reliably for non-trivial, long-running interactions.

Questions / Requests

  1. Is there a recommended workaround for implementing summarization in the current agents-based pipeline?
  2. Are there any plans to add first-class summarization support for agents (e.g., message summarization, context condensation, or pluggable summarizers)?
  3. If this is planned, is there an approximate timeline or milestone when this feature might be available?

This is a must-have feature for my use case, so any guidance on the intended direction or interim solutions would be greatly appreciated.

More details

NA

Which components are impacted by your request?

No response

Pictures

No response

Code of Conduct

  • I agree to follow this project's Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions