-
Notifications
You must be signed in to change notification settings - Fork 58
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
请教贴:文本最大长度 #114
Comments
|
好的谢谢 做问答检索的话,是直接计算就行?不需要提示语句吧? |
嗯嗯,是的。直接计算就行,也不需要提示语句。 |
请问一下,512个token大概多少个字符或者汉字呢? |
大概就是 512 个汉字 |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1.m3e最大长度是多少呢?按照文本字算的还是token呀?
2.如果是长文本的话按短句切分并保存到embedding库后续计算效果会更加好一点吗?
The text was updated successfully, but these errors were encountered: