All

116 repositories

llm-inference-handbook
Public
Everything you need to know about LLM inference
inference-optimization llm llm-inference
inference-optimization llm llm-inference inference-handbook inference-infrastructure
TypeScript
•
Apache License 2.0
•27•290•3•0•Updated Jun 5, 2026Jun 5, 2026
BentoML
Public
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
python machine-learning deep-learning
python machine-learning deep-learning model-serving multimodal mlops ml-engineering ai-inference llm generative-ai
Python
•
Apache License 2.0
•969•8.7k•138•27•Updated Jun 3, 2026Jun 3, 2026
OpenLLM
Public
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
llama mistral fine-tuning
llama mistral fine-tuning mlops bentoml vicuna llm model-inference llmops llm-serving
Python
•
Apache License 2.0
•813•12k•4•9•Updated Jun 2, 2026Jun 2, 2026
Yatai
Public
Model Deployment at Scale on Kubernetes 🦄️
kubernetes machine-learning k8s
kubernetes machine-learning k8s model-deployment model-serving mlops bentoml
TypeScript
•
Other
•76•844•21•13•Updated May 30, 2026May 30, 2026
papercups
Public
Open-source live customer chat
Elixir
•
MIT License
•570•0•0•7•Updated May 27, 2026May 27, 2026
Distributed-Visual-ChatGPT
Public
Scalable Visual-ChatGPT deployment on Kubernetes - Distributed multi-model inference graph powered by BentoML
aiapps llm
aiapps llm
Python
•
MIT License
•3.2k•16•0•3•Updated May 13, 2026May 13, 2026
chatgpt-lite
Public
Fast ChatGPT UI with support for both OpenAI and Azure OpenAI. 快速的ChatGPT UI，支持OpenAI和Azure OpenAI。
TypeScript
•
MIT License
•124•0•0•1•Updated May 12, 2026May 12, 2026
llama_index
Public archive
LlamaIndex (GPT Index) is a data framework for your LLM applications
Python
•
MIT License
•7.5k•1•0•3•Updated May 9, 2026May 9, 2026
BentoCrewAI
Public
Serving CrewAI Agent as REST API with BentoML, optionally with self-host open-source LLMs
Python
•1•22•0•2•Updated May 8, 2026May 8, 2026
BentoBark
Public
Python
•0•9•0•1•Updated May 8, 2026May 8, 2026
terraform-google-kubernetes-engine
Public
Configures opinionated GKE clusters
HCL
•
Apache License 2.0
•1.3k•0•0•7•Updated May 8, 2026May 8, 2026
csi-driver-image-populator
Public
CSI driver that uses a container image as a volume
Go
•
Apache License 2.0
•22•0•0•3•Updated May 8, 2026May 8, 2026
BentoQueue
Public
Python
•1•1•0•2•Updated May 8, 2026May 8, 2026
yatai-schemas
Public
Go
•2•1•1•1•Updated May 8, 2026May 8, 2026
sglang
Public
SGLang is a fast serving framework for large language models and vision language models.
Python
•
Apache License 2.0
•6.4k•0•0•1•Updated Apr 8, 2026Apr 8, 2026
BentoSGLang
Public
Python
•1•1•0•1•Updated Mar 26, 2026Mar 26, 2026
openllm-models
Public
Python
•17•65•0•1•Updated Mar 26, 2026Mar 26, 2026
helm-charts
Public
0•2•0•0•Updated Mar 24, 2026Mar 24, 2026
yatai-image-builder
Public
🐳 Build OCI images for Bentos in k8s
docker kubernetes docker-image
docker kubernetes docker-image container k8s container-image
Go
•12•19•5•13•Updated Mar 24, 2026Mar 24, 2026
yatai-common
Public
Go
•5•1•0•2•Updated Mar 7, 2026Mar 7, 2026
openai_emulator
Public
Python
•
Apache License 2.0
•0•0•0•0•Updated Mar 5, 2026Mar 5, 2026
.github
Public
✨🍱🦄️
4•1•0•0•Updated Mar 5, 2026Mar 5, 2026
BentoVLLM
Public
Self-host LLMs with vLLM and BentoML
Python
•
Apache License 2.0
•21•169•3•5•Updated Mar 3, 2026Mar 3, 2026
bentocloud-homepage-news
Public
2•2•0•0•Updated Feb 10, 2026Feb 10, 2026
BentoSpacy
Public
Python
•0•0•0•2•Updated Jan 26, 2026Jan 26, 2026
BentoTRTLLM
Public
Python
•1•10•2•2•Updated Jan 22, 2026Jan 22, 2026
mise-nebius
Public
Shell
•
MIT License
•0•0•0•0•Updated Jan 22, 2026Jan 22, 2026
BentoLMDeploy
Public
Self-host LLMs with LMDeploy and BentoML
Python
•2•22•1•1•Updated Dec 26, 2025Dec 26, 2025
BentoFunctionCalling
Public
Python
•1•9•0•2•Updated Dec 26, 2025Dec 26, 2025
lago
Public
Open Source Metering and Usage Based Billing API ⭐️ Consumption tracking, Subscription management, Pricing iterations, Payment orchestration & Revenue analytics
Go
•
GNU Affero General Public License v3.0
•620•0•0•1•Updated Nov 20, 2025Nov 20, 2025

ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

BentoML

All

All

116 repositories

llm-inference-handbook

BentoML

OpenLLM

Yatai

papercups

Distributed-Visual-ChatGPT

chatgpt-lite

llama_index

BentoCrewAI

BentoBark

terraform-google-kubernetes-engine

csi-driver-image-populator

BentoQueue

yatai-schemas

sglang

BentoSGLang

openllm-models

helm-charts

yatai-image-builder

yatai-common

openai_emulator

.github

BentoVLLM

bentocloud-homepage-news

BentoSpacy

BentoTRTLLM

mise-nebius

BentoLMDeploy

BentoFunctionCalling

lago

All

All

Repositories list

116 repositories