0.8.1 Feedback #103
inspir3dArt
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi,
I have tried out 0.8.1 and I'm really impressed. The new local model loading without copying it into the app internal storage works great.
For the character cards I would wish that the fields for "System Prompt" and "Jailbreak (post history instructions)" would be used / added, they are often used in character cards to steer the AI's behavior (Things like "Do not speak for {{user}}" or "Reply with long responses with at least 3 paragraphs.").
A option to trimm incomplete sentences at the end of a reply would be nice, like cutting away everything at the end until the last of the following signs: . ! ? ; * "
The performance is great with 7b and 8b models I tested (Q4 k_m quants).
Beta Was this translation helpful? Give feedback.
All reactions