Skip to content

[FEAT]: Disable Temperature Setting for DeepSeek-R1 (deepseek-reasoner) Model #2995

@spencerthayer

Description

@spencerthayer

When using the DeepSeek-R1 model (identified as deepseek-reasoner in AnythingLLM), the following error occurs, preventing successful message processing:

Could not respond to message.

400 deepseek-reasoner does not support the parameter `temperature`

This error arises because the DeepSeek-R1 model, as documented in the official DeepSeek-R1 repository (https://github.com/deepseek-ai/DeepSeek-R1#1-introduction), is specifically trained using Reinforcement Learning (RL) and does not support the temperature parameter. Attempting to include this parameter in API requests to the model results in the reported 400 error.

Currently, AnythingLLM presents the temperature setting as a configurable option in the UI for all language models, including deepseek-reasoner. This feature request aims to resolve this incompatibility and improve the user experience by disabling or hiding the temperature setting when the deepseek-reasoner model is selected.

Metadata

Metadata

Assignees

Labels

Integration RequestRequest for support of a new LLM, Embedder, or Vector databasebugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions