-
-
Notifications
You must be signed in to change notification settings - Fork 5k
Description
When using the DeepSeek-R1 model (identified as deepseek-reasoner
in AnythingLLM), the following error occurs, preventing successful message processing:
Could not respond to message.
400 deepseek-reasoner does not support the parameter `temperature`
This error arises because the DeepSeek-R1 model, as documented in the official DeepSeek-R1 repository (https://github.com/deepseek-ai/DeepSeek-R1#1-introduction), is specifically trained using Reinforcement Learning (RL) and does not support the temperature
parameter. Attempting to include this parameter in API requests to the model results in the reported 400
error.
Currently, AnythingLLM presents the temperature setting as a configurable option in the UI for all language models, including deepseek-reasoner
. This feature request aims to resolve this incompatibility and improve the user experience by disabling or hiding the temperature setting when the deepseek-reasoner
model is selected.