Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

flatten repetition_penalty_whitelist #24

Merged
merged 1 commit into from
Nov 26, 2023

Conversation

Fensterbank
Copy link
Contributor

I noticed the repetition_penalty_whitelist is sent to the API as array of arrays while the web ui is sending a flat array of numbers.
Therefore I don't know, if the way we are sending it now is even used by the API.

I'm not sure if my approach is good (I'm not a python developer), but it works.

Feel free to give hints on how better send the list as flat int array.

@Aedial
Copy link
Owner

Aedial commented Nov 26, 2023

It seems I indeed forgot to flatten the list. Side effect of using the tokenizer instead of token indexes directly.
Code seems fine, might have starred the lists for one less loop, but it's a minor detail.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants