[Enhance] Initialize the tokenizer only once#242

chensuyue merged 3 commits intomainopea-project/GenAIEval:mainfrom

zhenzhong/moveTokenizeropea-project/GenAIEval:zhenzhong/moveTokenizerCopy head branch name to clipboard