Allow configuration of base uri

[grafst]

This is very useful to use drop in replacements of the openai-api for local models.

[gehrisandro]

Hi @grafst

Thank you for your PR.

It looks like this is introducing a breaking change, because it will fail for all existing users not having the base_uri in their configuration file.
I think this can be fixed, by making the default null and only set the baseUri if a configuration exists and is not null.

And in my opinion there is no need to validate if the base uri is a string. Maybe we can just enforce a string casting.

[grafst]

yes you are totally right, it should just ignore if the config is not present.
Oh and really sorry I didn't see the other PR before :(

Is this now better?

[Xinecraft]

Hi,
Any update on getting this resolved and merged? or a new PR should be created?

[debjit]

So we still do not have any option to pass a custom URL for self-hosting LLM? Or just have to pass as an HTTP request?

[grafst]

Yes I will look into it soon.

On February 17, 2024, Markus Hilsenbeck ***@***.***> wrote: So we still do not have any option to pass a custom URL for self- hosting LLM? Or just have to pass as an HTTP request?

— Reply to this email directly, view it on GitHub <#72 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe- auth/ACAUED23YVD2ZCU4SSAYOETYUDIHHAVCNFSM6AAAAAA7N5TJZSVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSNJQGI2DGOJYGM>. You are receiving this because you were mentioned.Message ID: <openai- ***@***.***>

[giltotherescue]

I would also love to see this added. Am hoping to use this along with openrouter.ai to get access to many different models from one interface.