You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I'm having some trouble with a select that is for some reason exceeding the context window of the model. I'm using select to choose citations for a summary like this:
where pmcids is a list of ~15 strings like "PMC123456", with " " and "," to allow multiple references to be selected. I've isolated the problem down to this line, and the context is basically immediately exhausted here.
I see the Select class has a slot for max_tokens, do I understand correctly that it should then be possible to limit this generation to a number of tokens? select doesn't accept a max_tokens argument, is there any way to stop this from blowing up while keeping recurse or do I have to do something fancier?
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
I'm having some trouble with a
select
that is for some reason exceeding the context window of the model. I'm using select to choose citations for a summary like this:where
pmcids
is a list of ~15 strings like "PMC123456", with " " and "," to allow multiple references to be selected. I've isolated the problem down to this line, and the context is basically immediately exhausted here.I see the Select class has a slot for
max_tokens
, do I understand correctly that it should then be possible to limit this generation to a number of tokens?select
doesn't accept amax_tokens
argument, is there any way to stop this from blowing up while keepingrecurse
or do I have to do something fancier?Beta Was this translation helpful? Give feedback.
All reactions