Custom API Templates Discussion

[Vali-98]

Custom API Templates

Is ChatterUI missing an API you want to use?

v0.8.3-beta3 introduces API Configurations, which allows you to create customized endpoints (to a degree) which are missing from ChatterUI. Since these configs are JSON files, you can share them with other users!

Creating your own config is great if you are using an API which isn't handled by the existing API templates. You can cover use cases such as:

• is like OpenAI's, but it needs this extra sampler field!
• I have Ollama, but I want a configuration that adds an auth header!
• This API has differing model and completion endpoints!

Refer to this document on how to build your API template! Then, simply go to API Manager > Gear Icon > Add Template to load it into ChatterUI!

[3-ark]

Can you share the horde template in previous version? The new beta seems to have deleted it? Or it's a bug because I saw the horde.ts file is still there. Anyway, thanks.

[Vali-98]

Hey there, I haven't gotten around implementing horde properly just yet for the new API system!

[Vali-98]

Horde is now available again, both in the Legacy and new API systems:
https://github.com/Vali-98/ChatterUI/releases/tag/v0.8.3

[3-ark]

Saw it, thanks. But can you deselect the disappeared models? I found that after one model disappeared from the list the setting still keeps that, and I guess that leads to error.