Is it possible to have a simple character chat?

[xITmasterx]

I found this feature in Novel Mage that allows me to talk to my characters and interview them for understanding their character and their reasoning. I was hoping that it would be good to have such a feature, with a simple prompt to guide said character AI as well as the different things that it can look up on regarding their personality, appearance, backstory, etc.

Thanks on your great work with this tool and keep it up!

[GooseLander07]

I found this feature in Novel Mage that allows me to talk to my characters and interview them for understanding their character and their reasoning. I was hoping that it would be good to have such a feature, with a simple prompt to guide said character AI as well as the different things that it can look up on regarding their personality, appearance, backstory, etc.

Thanks on your great work with this tool and keep it up!

This seems like a lovely idea to implement. I will see if I can do something about it for future implementations. Currently there doesn't seem to be one. But I will let the maintainers tell ya about it

[stump-wiz]

I think "chatting with your characters" is one of the reasons we have the Workshop. You can create a prompt to tell the LLM that it should act like the character you choose, and then you just have to tick the checkboxes from the compendium and story so the LLM can read about the character and his/her experiences and personality in the story.

[xITmasterx]

I think "chatting with your characters" is one of the reasons we have the Workshop. You can create a prompt to tell the LLM that it should act like the character you choose, and then you just have to tick the checkboxes from the compendium and story so the LLM can read about the character and his/her experiences and personality in the story.

How would that work though, I wonder?

[stump-wiz]

There appears to be a bug, since the preview panel doesn't include the compendium information, and the preview should be what is sent to the LLM.

[GooseLander07]

You mean when choosing the compendium entries it never get included in the input prompt sent to the API?

[stump-wiz]

I need to do more investigating, but yes that's the problem. The Workshop has a layer that writes a summary from the previous chat conversations, and I think when that layer kicks in it might consume the compendium data instead of passing it through.

[stump-wiz]

I submitted my latest fixes for generating Chapter and Act summaries when the story exceeds the token limits of the LLM. Now I'll work on this issue.

[stump-wiz]

While debugging this, I can see that the compendium entries are concatenated into the end of the user input, typically after the story text, which makes it difficult for the LLM to figure out which character you want it to role play. I'm working on a fix. The fix might get complicated when you have a long chat session ongoing.

[xITmasterx]

While debugging this, I can see that the compendium entries are concatenated into the end of the user input, typically after the story text, which makes it difficult for the LLM to figure out which character you want it to role play. I'm working on a fix. The fix might get complicated when you have a long chat session ongoing.

How bad is it?

[stump-wiz]

I decided to create a new "Roleplay" chat mode, so when you click on "New Chat" you get a pop-up dialog that asks you to choose "Writing Coach" or "Role Play" mode. The main difference so far is that I added a new Roleplay prompt category, so you can keep your roleplay prompts separate from your writing assistance prompts. However, I need to run a few scenarios to make sure they both work. I ran into a bug where attaching the story scene triggers an AI summary (to reduce the number of tokens and leave room for the chat history) and it forgets who it was roleplaying as. There are trade-offs that I have to resolve, and I wonder how ChatGPT and other websites deal with large attachments. Maybe the models can handle more tokens. I need to do more research.

I shelved this work so I could work on the easier issues. I hope I can pick it up again on Monday.

[xITmasterx]

Has this still been worked on?

[stump-wiz]

I'm back from taking q brief vacation. Before that, I had to work on release 0.14.7 to fix a bug. I'm ready to resume work on this now.

[xITmasterx]

Is it almost done? Or do you need help with that?