-
Notifications
You must be signed in to change notification settings - Fork 2.8k
feat(langchain/createAgent): Add support for callOptions to middleware #9110
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: v1
Are you sure you want to change the base?
feat(langchain/createAgent): Add support for callOptions to middleware #9110
Conversation
|
@pokey is attempting to deploy a commit to the LangChain Team on Vercel. A member of the Team first needs to authorize it. |
The latest updates on your projects. Learn more about Vercel for GitHub. 1 Skipped Deployment
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM 👍
Let's sync with the Python team on the new property on ModelRequest
…-calloptions-to-middleware
As discussed with @eyurtsev, we're holding off on merging this one until we look into Python version |
/** | ||
* Extra call options to pass to the model. | ||
*/ | ||
callOptions?: Record<string, unknown>; |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
cc @christian-bromann / @pokey is this a standard name in js?
@sydney-runkle this is extra config that we'll be passing to chat model invoke. We can either use the same standard name if it makes sense or follow whatever is convention in each language.
- extra_params
- invoke_kwargs
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
to be more specific here I would suggest modelCallOptions
as an alternative.
This allows us to pass things like
headers
andcontainer
to the model call