We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
模型训练与精调
Llama-3-Chinese-8B(基座模型)
Linux
# 请在此处粘贴运行代码(请粘贴在本代码块里)
因为需要做某个垂直领域的llama3,由于包含很多专有词汇,直接做指令微调效果甚微。 所以想请教一下如何做增量预训练。或者其他可以让llama3更适合某一专业领域的训练方法。
# 请在此处粘贴依赖情况(请粘贴在本代码块里)
# 请在此处粘贴运行日志(请粘贴在本代码块里)
The text was updated successfully, but these errors were encountered:
No branches or pull requests
提交前必须检查以下项目
问题类型
模型训练与精调
基础模型
Llama-3-Chinese-8B(基座模型)
操作系统
Linux
详细描述问题
因为需要做某个垂直领域的llama3,由于包含很多专有词汇,直接做指令微调效果甚微。 所以想请教一下如何做增量预训练。或者其他可以让llama3更适合某一专业领域的训练方法。
依赖情况(代码类问题务必提供)
运行日志或截图
The text was updated successfully, but these errors were encountered: