Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] 关于“面具”能力全面向“GPTs”看齐的建议 #3217

Closed
devyujie opened this issue Nov 10, 2023 · 18 comments
Closed

[Feature] 关于“面具”能力全面向“GPTs”看齐的建议 #3217

devyujie opened this issue Nov 10, 2023 · 18 comments

Comments

@devyujie
Copy link

为了提高交流效率,我们设立了官方 QQ 群和 QQ 频道,如果你在使用或者搭建过程中遇到了任何问题,请先第一时间加群或者频道咨询解决,除非是可以稳定复现的 Bug 或者较为有创意的功能建议,否则请不要随意往 Issue 区发送低质无意义帖子。

点击加入官方群聊

这个功能与现有的问题有关吗?

你想要什么功能或者有什么建议?
看到推上分享的 GPTs 功能,非常惊讶,这不就是“面具”吗,合理怀疑 CloseAI 抄袭本项目创意。

给每个对话设置预设词、定制模型参数、Zero One and Few Shot 等是早已实现的功能,现在就差 DALL-E 3、GPT-4 V 以及 Assistants API,今天突发奇想,又稍微想到几个建议:

先单独设置两个置顶 Tab 给 DALL E 和 Assistants,仅提供生图和上传/分析文件的能力,🔗因为 未来几个月 Assistants API 会将 DALL E 和 GPT-4 V 融合进来,所以到时候仅通过 Assistants API 就可以在对话内完成多模态能力。
image

等融合完毕之后,再把 Assistants 加到全局或者对话设置里,成为常驻嘉宾,通过开关按钮,来开启/关闭是否启用文生图是否允许上传图片是否允许上传文件等功能,同时可以分别设置相应的功能参数(类似 GPTs 的预设提示词啥的...),按钮打开后,相应的 UI 控件才会显示到对话中,这样也给用户极大地选择空间,到时候面具就会全面拥有多模态能力,哦对,还有 TTS 等语音功能。

关于上网能力,这里有一个🔗参考
关于 Assistants API 的能力扩展(接入各种知识库的开放 API),这里有一个🔗列表

有没有可以参考的同类竞品?

其他信息

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Title: [Feature] Suggestions on “Mask” capabilities being fully aligned with “GPTs”

In order to improve communication efficiency, we have set up an official QQ group and QQ channel. If you encounter any problems during use or construction, please join the group or channel for consultation as soon as possible, unless it is a bug that can be stably reproduced or More creative feature suggestions, otherwise please do not send low-quality and meaningless posts to the Issue area.

Click to join the official group chat

**Is this feature related to an existing issue? **
,

**What features do you want or have any suggestions? **
I was very surprised to see the GPTs function shared on Twitter. Isn’t this a “mask”? It is reasonable to suspect that CloseAI plagiarized the idea of ​​this project.

Setting preset words for each conversation, customizing model parameters, Zero One and Few Shot, etc. are functions that have been implemented for a long time. Now we only need DALL-E 3, GPT-4 V and Assistants API. Today I had a whim and thought of a few more suggestions:

First, set up two separate top tabs for DALL E and Assistants, which only provide the ability to generate pictures and upload/analyze files, 🔗[because](https://platform.openai.com/docs/assistants/how-it-works/ limitations) In the next few months, the Assistants API will integrate DALL E and GPT-4 V, so multi-modal capabilities can be completed within the conversation only through the Assistants API.
image

After the integration is completed, add Assistants to the global or conversation settings to become a permanent guest. Use the switch button to turn on/off whether to enable Vincentian pictures, whether to allow uploading of pictures, whether Functions such as uploading files are allowed, and corresponding function parameters can be set separately (similar to the preset prompt words of GPTs...). After the button is turned on, the corresponding UI controls will be displayed in the dialog, which also provides users with With a huge choice space, mask will have full multi-modal capabilities by then, and yes, there will also be voice functions such as TTS.

Regarding Internet access capabilities, here is a 🔗reference
Regarding the capability expansion of Assistants API (open API that accesses various knowledge bases), here is a 🔗list

**Are there any similar competing products that we can refer to? **
,

other information
,

@ClarenceDan
Copy link
Contributor

很好的想法,这样面具就类似 assistant,而插件类似于官网的插件,但是这样似乎和官方的能力拉不开差距?(还是官方太猛了)

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


It's a very good idea, so that the mask is similar to the assistant, and the plug-in is similar to the plug-in on the official website, but this seems to be unable to close the gap with the official capabilities? (Official is still too fierce)

@devyujie
Copy link
Author

很好的想法,这样面具就类似 assistant,而插件类似于官网的插件,但是这样似乎和官方的能力拉不开差距?(还是官方太猛了)

对,该接入的接入,毕竟人家提供 API 了,拉开差距可能要 3.0 版的插件😋

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


It's a very good idea, so that the mask is similar to the assistant, and the plug-in is similar to the plug-in on the official website, but this seems to be unable to close the gap with the official capabilities? (Official is still too fierce)

Yes, the access should be accessed. After all, they provide API. To widen the gap, you may need version 3.0(#138 (comment)) Plugin 😋

@devyujie
Copy link
Author

很好的想法,这样面具就类似 assistant,而插件类似于官网的插件,但是这样似乎和官方的能力拉不开差距?(还是官方太猛了)

我觉得不需要拉开差距,把这些弄完就很丰富了,咱们用 API 的魔力在于随时想用就用,想玩就玩,每月又不用花太多钱,需求大的早都开 Plus 去了,毕竟无限用,使用门槛又低。

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


It's a very good idea, so that the mask is similar to the assistant, and the plug-in is similar to the plug-in on the official website, but this seems to be a big gap with the official capabilities? (Official is still too fierce)

I don’t think there is a need to widen the gap. Once these are completed, it will be very rich. The magic of us using API is that we can use it whenever we want and play whenever we want. We don’t have to spend too much money every month. If there is a big demand, we can open Plus early. Go, after all, it has unlimited uses and the threshold for use is low.

@H0llyW00dzZ
Copy link
Contributor

H0llyW00dzZ commented Nov 11, 2023

also for code interpreting since we already had mask, it only need file upload system

Desktop.2023.11.11.-.23.08.45.04.mp4

@H0llyW00dzZ
Copy link
Contributor

another show case about code interpreting LLM Api (this a wilds)

image

image

image

@davideuler
Copy link

Assistant API 使用的7个例子,可以参考这里:
https://github.com/davideuler/awesome-assistant-api

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


For 7 examples of Assistant API usage, please refer here:
https://github.com/davideuler/awesome-assistant-api

@ChrisXHL
Copy link

要不先把文件上传功能放上去,嘿嘿,API 还是快很多,比官网体验好多了

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


Why not put the file upload function first? Hehe, the API is still much faster and the experience is much better than the official website.

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


My side supports the gpt4-vision-preview image recognition function, you can learn more about it.
https://github.com/vual/ChatGPT-Next-Web-Pro

@vual

This comment was marked as abuse.

@Issues-translate-bot
Copy link

Bot detected the issue body's language is not English, translate it automatically.


I have added gpts store support here. If you need it, you can learn more: https://github.com/vual/ChatGPT-Next-Web-Pro

@lloydzhou
Copy link
Collaborator

lloydzhou commented Sep 2, 2024

see #5331 #5353

@Issues-translate-bot

This comment was marked as duplicate.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

8 participants