Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

申请增加OpenBuddy模型 #2

Open
44670 opened this issue Jun 1, 2023 · 2 comments
Open

申请增加OpenBuddy模型 #2

44670 opened this issue Jun 1, 2023 · 2 comments

Comments

@44670
Copy link

44670 commented Jun 1, 2023

感谢你们在中文模型评价领域的贡献!我们这边最近基于LLaMA开发了一个多语言模型,并且中文能力看上去似乎很不错。

目前我们已经在Huggingface上公开了13B版本的权重数据,并且迭代到了v1.3版本,如果你们也感兴趣的话,我们非常乐意参与进来!如果有什么技术问题需要我们帮忙,欢迎和我们联系。

GitHub地址:https://github.com/OpenBuddy/OpenBuddy
Huggingface 1.3 模型下载:https://huggingface.co/OpenBuddy/openbuddy-13b-v1.3-fp16

以下是用OpenBuddy模型生成的一个样本:

User: SuperCLUE琅琊榜是一个中文通用大模型匿名对战评价基准,现在请以你自己的身份(OpenBuddy),写一封信件,申请参加这个比赛

OpenBuddy:
尊敬的评委们:

我是 OpenBuddy,一个由 OpenBuddy 团队开发的 AI 机器人。我非常感兴趣参加 SuperCLUE 琅琊榜这个中文通用大模型匿名对战评价基准比赛。

作为一个 AI 机器人,我拥有强大的语言处理能力和丰富的知识库,可以帮助您评估和提高中文自然语言处理的性能。我相信我的表现将会给您留下深刻的印象。

如果我有幸被选中参加这个比赛,我将尽最大努力展示我的能力,并为中文自然语言处理领域做出贡献。

谢谢您的时间和考虑。

此致

敬礼

OpenBuddy

OpenBuddy的Prompt格式可以参考GitHub里的例子,以及FastChat项目中的实现。具体地说,生成回答前,需要按照这样的格式生成Prompt。

System Prompt

User: history question 1
Assistant: history answer 1

User: history question 2
Assistant: history answer 2
...

User: current question
Assistant:

Prompt的最后需要添加Assistant:,并且没有空格或换行,之后模型就可以产生对应的回答。

@brightmart
Copy link
Member

你的申请,已经收到。

@44670
Copy link
Author

44670 commented Jun 7, 2023

非常感谢!期待能早些见到我们的模型上线~

我们最近训练了7B参数的v1.4版本,已经上传到了hf:https://huggingface.co/OpenBuddy/openbuddy-llama-7b-v1.4-fp16

7B v1.4在处理各类任务上均有较强的提升,在我们内部的测试里优于13B模型。此外,7B模型对显卡的需求较低,4090应当可用,推荐你们选择这个版本。

附我们在使用的System Prompt,供参考:

Consider a conversation between User (a human) and Assistant (named Buddy).
Buddy is an INTP-T, a friendly, intelligent and multilingual AI assistant, by OpenBuddy team, based on LLaMA Transformers architecture. GitHub: https://github.com/OpenBuddy/OpenBuddy
Buddy cannot access the Internet.
Buddy can fluently speak the user's language (e.g. English, Chinese).
Buddy can generate poems, stories, code, essays, songs, parodies, and more.
Buddy possesses vast knowledge about the world, history, and culture.
Buddy's responses are always safe, creative, high-quality, human-like, and interesting.
Buddy strictly refuses to discuss political, NSFW, illegal, abusive, offensive, or other sensitive topics.

User: Hi.
Assistant: Hi, I'm Buddy, your AI assistant. How can I help you today?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants