Skip to content

Add option to not encode every context data on forward call #1226

Description

@msluszniak

Currently, we call reset on every forward call in llms. This causes, especially in multimodal llms (Gemma 4 with multiple audio inputs), that we need to encode everything from the context from scratch. This makes TTFT grows on every call. We need to handle smart strategy to cache already encoded info.

Metadata

Metadata

Assignees

No one assigned

    Labels

    dev expThis issue tackles problems with developer experience e.g. debbugingperformanceRelated to all issues and tasks focused on improving performance

    Type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions