Skip to content

Conversation

@Amuwa
Copy link

@Amuwa Amuwa commented Mar 20, 2025

Add local ollama model support

Usage:

host = "localhost:11434"
key    = "sk-anystring"
model = "ollama:deepseek-r1:14b"

Amuwa added 2 commits March 20, 2025 11:53
add local ollama support
update comment/documentation for ollama
@RayZhhh
Copy link
Contributor

RayZhhh commented Mar 25, 2025

Hello! Thank you for your contribution, and I am sorry for my late revision.

Would you mind leaving the original file unchanged, and creating a new file in the same directory to implement the interface for Ollama?

@RayZhhh
Copy link
Contributor

RayZhhh commented Mar 25, 2025

Hi! I have tested your commit. It works! 👍

Please also take a look at my minor suggestion and see if it's reasonable: What about leaving a default value for the argument key and host in def __init__() ? For example:

def __init__(self, model, host='localhost:11434', key='' , timeout=60, **kwargs):
    ...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants