Skip to content

[Request] 支持火山方舟的上下文缓存 #7137

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
samurai00 opened this issue Mar 25, 2025 · 2 comments
Open

[Request] 支持火山方舟的上下文缓存 #7137

samurai00 opened this issue Mar 25, 2025 · 2 comments
Labels
🌠 Feature Request New feature or request | 特性与建议

Comments

@samurai00
Copy link
Contributor

samurai00 commented Mar 25, 2025

🥰 需求描述

最近火山方舟也开始支持 DeepSeek-R1 的上下文缓存了。

其他家,像阿里百炼、腾讯云好像都没支持。硅基流动貌似也没有。

是否考虑也支持一下?
比如通过在 AI Providers 中配置是否开启上下文缓存,在会话级别开启或者默认开启?

🧐 解决方案

他这个好像跟 DeepSeek 官方的不一样,不会自动触发缓存。
需要用额外的接口创建缓存。

📝 补充信息

不过看文档目前 deepseek-r1 仅支持前缀缓存,而不是 Session 缓存,聊天机器人场景作用貌似有限。

No response

@lobehubbot
Copy link
Member

Bot detected the issue body's language is not English, translate it automatically. 👯👭🏻🧑‍🤝‍🧑👫🧑🏿‍🤝‍🧑🏻👩🏾‍🤝‍👨🏿👬🏿


🥰 Requirement description

Recently, Volcanic Ark has also begun to support DeepSeek-R1's context cache.

Other companies, such as Alibaba Bailian and Tencent Cloud, seem to have no support. There doesn't seem to be silicon-based flow either.

Do you consider supporting it?
For example, by configuring whether context cache is enabled in AI Providers, turn on at the session level or turn on by default?

🧐 Solution

His seems to be different from the official DeepSeek, and the cache will not be automatically triggered.
An additional interface is required to create a cache.

📝 Supplementary information

No response

@lobehubbot
Copy link
Member

👀 @samurai00

Thank you for raising an issue. We will investigate into the matter and get back to you as soon as possible.
Please make sure you have given us as much context as possible.
非常感谢您提交 issue。我们会尽快调查此事,并尽快回复您。 请确保您已经提供了尽可能多的背景信息。

@dosubot dosubot bot added the 🌠 Feature Request New feature or request | 特性与建议 label Mar 25, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🌠 Feature Request New feature or request | 特性与建议
Projects
None yet
Development

No branches or pull requests

2 participants