Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Documentation examples don't work with different LLM #313

Open
Thomasillo opened this issue Jun 5, 2024 · 1 comment
Open

Documentation examples don't work with different LLM #313

Thomasillo opened this issue Jun 5, 2024 · 1 comment

Comments

@Thomasillo
Copy link

I am using the semantic_router.encoders.AzureOpenAIEncoder and semantic_router.llms.AzureOpenAILLM.

When trying to reproduce the examples from docs/02-dynamic-routes.ipynb, but with those encoder/llm.
When using semantic_route.llms.openai.get_schemas_openai, asking a RouteLayer will fail with a ValueError.
(Logger says: 2024-06-05 18:14:46 ERROR semantic_router.utils.logger Single input validation error: 'signature')
The error comes from semantic_router/llms/base.py:76 (in v0.0.46) where a 'signature' key is requested from the function schema.

When exchanging for semantic_router.utils.function_call.get_schema, the RouteChoice ouput is incomplete, missing the function name. Multi function routes don't work at all with this llm/encoder.

@Siraj-Aizlewood
Copy link
Contributor

Hi @Thomasillo , please can you share your altered version of the 02 notebook, just so I can try and reproduce the error? I think I've got an idea of what's causing this but it would be good to replicate the exact same situation.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants