Skip to content

Commit

Permalink
Grab model data dynamically instead of hardcoded
Browse files Browse the repository at this point in the history 
- Dynamically resolve max token count
- Dynamically resolve tokenizers
- Use only stream function not both callback and stream and distinguish type of response instead

Signed-off-by: Tomas Slusny <[email protected]>
  • Loading branch information
@deathbeam
deathbeam committed Nov 2, 2024
1 parent ae6b0c0 commit f492023
Show file tree
Hide file tree
Showing 3 changed files with 276 additions and 287 deletions.
Loading

0 comments on commit f492023

Please sign in to comment.