This repository was archived by the owner on Mar 13, 2025. It is now read-only.

Serve a new model without restarting RayLLM #130

Closed

k6l3 opened this issue Feb 2, 2024 · 1 comment

k6l3 commented Feb 2, 2024

Is it possible to start serving a new model when an event happens?

samarth-contextual commented Feb 9, 2024

Bumping this.

kouroshHakha closed this as not planned

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.