Cannot load encoding when offline

[rjgleaton]

Hello,

Is it possible to load a HarmonyEncoding when offline via local files? load_harmony_encoding seems to be the only way to obtain a HarmonyEncoding object, but it appears to always try to download the vocabulary from the internet.

If not, it would be nice to provide a way to do so!

Appreciate your time.

[amirhosseinghanipour]

yes, you can load a HarmonyEncoding from local files. the lib already supports this via an environment variable that isn't documented in the main docs. you can set TIKTOKEN_ENCODINGS_BASE to a dir that contains the vocab file(s), for HarmonyGptOss the loader expects a file named o200k_base.tiktoken in that dir (same file as the one normally downloaded).