Skip to content

feat: llm-mock-server support Ollama simulation #13

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
Patrisam wants to merge 2 commits into
base: main
Choose a base branch
from
Open

feat: llm-mock-server support Ollama simulation #13

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f33175b
support ollama
Patrisam Nov 2, 2025
1243765
Update provider.go
Patrisam Nov 3, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions llm-mock-server/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,3 +31,4 @@
- 文心一言
- 智谱 AI
- 阶跃星辰
- Ollama
2 changes: 1 addition & 1 deletion llm-mock-server/pkg/provider/chat/provider.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -86,7 +86,7 @@ func SetupRoutes(server *gin.Engine, providerType string) {
case "cloudflare":
server.POST("/client/v4/accounts/:accountId/ai/v1/chat/completions", chatCompletionsHandlers["cloudflare"].HandleChatCompletions)
// 其他 cases...
case "openai", "ai360", "deepseek", "together", "baichuan", "yi", "stepfun":
case "openai", "ai360", "deepseek", "together", "baichuan", "yi", "ollama", "stepfun":
// 这些provider都使用OpenAI兼容的格式，调用openAiProvider
server.POST("/v1/chat/completions", chatCompletionsHandlers["openai"].HandleChatCompletions)
Comment on lines +89 to 91
Copy link
Member

@hanxiantao hanxiantao Nov 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

这里mock-server启动的时候应该不会指定对应的providerType参数，默认走的是default中的逻辑，应该会启用所有路由，应该和e2e那边的报错没有关系
image

Copy link
Contributor Author

@Patrisam Patrisam Nov 5, 2025

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

谢谢老师，我在本地配置环境运行一下，再排查一下是什么问题

default:
Expand Down