Skip to content

Feat/vultr serverless inference #126

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
shauber wants to merge 5 commits into from
Closed

Feat/vultr serverless inference #126

shauber wants to merge 5 commits into from

Conversation

@shauber
Copy link

@shauber shauber commented Dec 17, 2025

  • [ x] I have read CONTRIBUTING.md.
  • I have created a discussion that was approved by a maintainer (for new features). -- Pretty sure adding a new provider doesn't require this

Shawn Craver and others added 4 commits December 15, 2025 10:42
feat: add Vultr serverless inference provider support
dcb7f51 
- Add Vultr API configuration with 5 supported models
- Register vultrProvider in provider registry
- Supports OpenAI-compatible endpoint for Kimi K2, Llama 3.1, Mistral, DeepSeek, and Qwen models
- Uses correct API endpoint: https://api.vultrinference.com/
- Kimi K2 set as default large model (256k context window)
@charmcli @shauber
chore: auto-update generated files
c75fee0
@kujtimiihoxha @shauber
chore: update deepseek models
79fde0f
@charmcli @shauber
chore: auto-update generated files
3cc5d53
@shauber shauber requested a review from a team as a code owner December 17, 2025 15:24
@shauber shauber requested review from andreynering and kujtimiihoxha and removed request for a team December 17, 2025 15:24
@kujtimiihoxha
Copy link
Member

kujtimiihoxha commented Jan 5, 2026

Looks like a duplicate of #133 will close this one.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@andreynering andreynering Awaiting requested review from andreynering andreynering is a code owner automatically assigned from charmbracelet/everyone

@kujtimiihoxha kujtimiihoxha Awaiting requested review from kujtimiihoxha kujtimiihoxha is a code owner automatically assigned from charmbracelet/everyone

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@shauber @kujtimiihoxha @charmcli