Skip to content

Commit

Permalink
[API] Fix wrong file for nerdstash v2
Browse files Browse the repository at this point in the history
  • Loading branch information
Aedial committed May 20, 2023
1 parent 38dbf93 commit 80797d0
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion novelai_api/Tokenizer.py
Original file line number Diff line number Diff line change
Expand Up @@ -60,7 +60,7 @@ def get_tokenizer_name(cls, model: Model) -> str:
_NERDSTASH_TOKENIZER_v1.decode = _NERDSTASH_TOKENIZER_v1.DecodeIds

_NERDSTASH_TOKENIZER_v2 = sentencepiece.SentencePieceProcessor()
_NERDSTASH_TOKENIZER_v2.Load(str(tokenizers_path / "nerdstash_v1.model"))
_NERDSTASH_TOKENIZER_v2.Load(str(tokenizers_path / "nerdstash_v2.model"))
_NERDSTASH_TOKENIZER_v2.encode = _NERDSTASH_TOKENIZER_v2.EncodeAsIds
_NERDSTASH_TOKENIZER_v2.decode = _NERDSTASH_TOKENIZER_v2.DecodeIds

Expand Down

0 comments on commit 80797d0

Please sign in to comment.