Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

这个项目把本地LLM接入微信了吗 #3

Open
Chain-Mao opened this issue Jun 27, 2024 · 8 comments
Open

这个项目把本地LLM接入微信了吗 #3

Chain-Mao opened this issue Jun 27, 2024 · 8 comments

Comments

@Chain-Mao
Copy link

是不是只是接了GPT3.5的接口,而没有接入本地模型

@xming521
Copy link
Owner

接入的是本地模型,只不过用了openai的接口格式

@Chain-Mao
Copy link
Author

接入的是本地模型,只不过用了openai的接口格式

感谢回复,但是我没看到哪里加载和调用本地模型,能解答下吗

@xming521
Copy link
Owner

xming521 commented Jun 27, 2024

python ./src/api_service.py # 加载调用模型
我也是封装的其他库,找起来可能比较深

@Chain-Mao
Copy link
Author

Chain-Mao commented Jun 27, 2024

python ./src/api_service.py # 加载调用模型 我也是封装的其他库,找起来可能比较深

我想使用Llama3和Qwen2等其它模型接入微信,请问有什么修改建议吗

@xming521
Copy link
Owner

我用的是LLaMA-Factory 这个库,具体可以看看这个库

@Solenyalyl
Copy link

这里是怎么调用本地模型的?训练好了之后的模型就可以直接调用吗?

@Solenyalyl
Copy link

本地训练好的chatglm3模型怎么接?

@Solenyalyl
Copy link

用的是chatglm3-6b的训练模型,调用之后一直报错404 not found,直接测试api-service.py是可以直接跑的,请问还有哪里需要修改吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants