Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow KoboldAI backend support #86

Open
wereretot opened this issue Nov 24, 2023 · 1 comment
Open

Allow KoboldAI backend support #86

wereretot opened this issue Nov 24, 2023 · 1 comment

Comments

@wereretot
Copy link

wereretot commented Nov 24, 2023

Describe the solution you'd like
I want an option to be able to use the KoboldAI API to allow a way of local use.

Describe alternatives you've considered
The problems with cloud hosted solutions like c.ai are that they can change and also be taken away at the whim of the company, but with local hosting this would no longer be a worry. It also allows a more reliable and faster method of using MonikA.I if the user's hardware is able to handle the model they have loaded on the KoboldAI backend.

Additional context
You can find the KoboldAI GitHub repository here: https://github.com/KoboldAI/KoboldAI-Client
If you need assistant with the API or have any questions, you may contact the developers of KAI on the official KoboldAI Discord server here: https://discord.gg/rrsAaPPRYa

Repository owner deleted a comment from SamuelSithakoul Nov 25, 2023
@Rubiksman78
Copy link
Owner

An update is ongoing using Oobabooga text-generation-webui as a backend that will allow the same kind of features with an easier installation. I believe it will be sufficient for current needs and offers as much stability.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants