Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Please register with the .register("local") method provided in LLMRegistry registry #137

Open
nuocheng opened this issue Jun 21, 2024 · 0 comments

Comments

@nuocheng
Copy link

你好,我根据https://github.com/OpenBMB/AgentVerse/blob/main/README_simulation_cases.md这里面的任务进行操作的时候出现了如下问题:
ValueError: local is not registered. Please register with the .register("local") method provided in LLMRegistry registry

我目前相关配置:

  1. llm部署:本地部署的qwen1.5-7b-chat模型,使用vllm进行部署,使用openai起的服务http://localhost:12073/v1/chat/completions
  2. 项目中配置:1)agentverse/tasks/nlp_classroom_9players/config.yaml有关llm_type:local model:Qwen1.5-7B-Chat
    2)agentverse/llms/__init__.pyLOCAL_LLMS加入了Qwen1.5-7B-ChatLOCAL_LLMS_MAPPING中加入了Qwen1.5-7B-Chat的hf_model_name,base_url,api_key

但是会出现 local is not registered的问题
请问是还需要配置其他地方吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant