How do I set the local model to chat instead of text generation? #118
-
|
The App Mode is ‘Local’, and selected the local .gguf model, the other configurations are default. But it just generates its own text during the dialogue. |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment 1 reply
-
|
At the moment, local generations only use text completion. I would recommend looking at your model's stop tokens to properly stop said model from further generations. |
Beta Was this translation helpful? Give feedback.
-
|
Maybe there is something wrong with the model I chose called |
Beta Was this translation helpful? Give feedback.
At the moment, local generations only use text completion.
I would recommend looking at your model's stop tokens to properly stop said model from further generations.