Skip to content

add: ollama cloud #96

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
vorticalbox wants to merge 1 commit into
base: main
Choose a base branch
from
Open

add: ollama cloud #96

vorticalbox wants to merge 1 commit into from

Conversation

@vorticalbox
Copy link
Contributor

@vorticalbox vorticalbox commented Oct 30, 2025 •
edited
Loading

  • I have read CONTRIBUTING.md.

  • I have created a discussion that was approved by a maintainer (for new features).

  • Set Claude Haiku 4.5 as default small model

  • Update Claude Sonnet 4.5 pricing (reduced output costs)

  • Remove outdated Claude 3.5 Haiku and Opus models

  • Reorder models by relevance

@vorticalbox vorticalbox requested a review from a team as a code owner October 30, 2025 09:03
@vorticalbox vorticalbox requested review from aymanbagabas and tauraamui and removed request for a team October 30, 2025 09:03
@vorticalbox vorticalbox changed the title Update AWS Bedrock model configuration chore: Update AWS Bedrock model configuration Nov 5, 2025
@vorticalbox vorticalbox changed the title chore: Update AWS Bedrock model configuration add: ollama cloud Nov 7, 2025
@gotjoshua
Copy link

gotjoshua commented Dec 3, 2025

this looks great! Is there a way i can preview this before the merge?
@vorticalbox
and @charmcrush any eta on merge?

@meowgorithm
Copy link
Member

meowgorithm commented Dec 3, 2025

Hey! Sorry for the delay on this one. In order to get this in we'll need to do some work in Fantasy to support Ollama Cloud, since it's not OpenAI or Anthropic compatible. No ETA yet but we'd love to get support for this in.

@vorticalbox
Copy link
Contributor Author

vorticalbox commented Dec 3, 2025 •
edited
Loading

Hey! Sorry for the delay on this one. In order to get this in we'll need to do some work in Fantasy to support Ollama Cloud, since it's not OpenAI or Anthropic compatible. No ETA yet but we'd love to get support for this in.

I already have a pr open in fantasy to support it i just need to update my branch

charmbracelet/fantasy#63

@vorticalbox
Copy link
Contributor Author

vorticalbox commented Dec 3, 2025

this looks great! Is there a way i can preview this before the merge? @vorticalbox and @charmcrush any eta on merge?

  • Clone both repos: git clone <crush_repo> and git clone <fantasy_repo>.
  • In crush/go.mod, add a replace directive pointing to your local fantasy folder:
    replace charm.land/fantasy => ../fantasy
  • Create providers.json in the Crush repo and paste in the JSON from the provided source.
  • From the Crush repo, run: go crush update-providors path/to/providers.json
  • Start Crush: go run main.go

After this, Crush will run with fantasy support and can use Ollama Cloud.

tennox added a commit to tennox/crush that referenced this pull request Dec 4, 2025
@tennox
feat: add local development setup for Ollama Cloud testing
834d222 
Add replace directives for local fantasy and catwalk repos to test
Ollama Cloud integration from PRs charmbracelet/fantasy#63 and
charmbracelet/catwalk#96.
@vorticalbox
feat: add Ollama Cloud provider configuration
218d050 
Add provider configuration for Ollama Cloud with the following models:
- DeepSeek V3.1 671B (reasoning)
- GPT-OSS 120B (reasoning)
- GPT-OSS 20B
- Kimi K2 1T (reasoning)
- Qwen3 Coder 480B
- GLM 4.6 (reasoning)
- Minimax M2

All models are currently free (0 cost per token) and support
128K context window with 4K default max tokens.

Requires fantasy provider: charm.land/fantasy/providers/ollamacloud
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@tauraamui tauraamui Awaiting requested review from tauraamui tauraamui is a code owner automatically assigned from charmbracelet/everyone

@aymanbagabas aymanbagabas Awaiting requested review from aymanbagabas aymanbagabas is a code owner automatically assigned from charmbracelet/everyone

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@vorticalbox @gotjoshua @meowgorithm