Skip to content

swaynehales/vllm-mlx

 
 

Repository files navigation

vllm-mlx Fork

This repository is a public fork of waybarrios/vllm-mlx.

The fork is being rebuilt around the current upstream codebase with a small set of runtime improvements for local Apple Silicon serving. The full README is being rewritten and will be updated after the branch cleanup is complete.

For current upstream usage documentation, see waybarrios/vllm-mlx.

About

Fork of OpenAI and Anthropic compatible server for Apple Silicon. Native MLX backend, 500+ tok/s. Run LLMs and vision-language models with continuous batching, MCP tool calling, and multimodal support.

Topics

Resources

License

Stars

1 star

Watchers

0 watching

Forks

Packages

 
 
 

Contributors

Languages

  • Python 99.8%
  • Shell 0.2%