You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
@AriMKatz The best way to solve this is probably to make two separate copies of your model, each with a different "contextLength" parameter
After context providers resolve their contents, we then do prompt pruning to fit it into the context window, so context providers like @ codebase don't take into account contextLength by themselves
Seems like what you might want is the ability to have @ codebase automatically grab more results when you're using the longer context model?
Validations
Problem
Newer models like sonnet 3.5 do well across almost the entire context window, but I might not want to use it for every chat.
Solution
Please allow dynamically setting context window.
Right now only can change in model load #1364
Also, does the context provider account for this?
The text was updated successfully, but these errors were encountered: