Skip to content
This repository was archived by the owner on Jul 10, 2026. It is now read-only.
This repository was archived by the owner on Jul 10, 2026. It is now read-only.

[FeatureRequest] Add streaming support to openAI compatible api. #10

Open
Open
[FeatureRequest] Add streaming support to openAI compatible api.#10
Labels
enhancementNew feature or request

Description

@s-kostyaev
s-kostyaev
opened on May 7, 2024

For now api not fully compatible with openAI one, it lacks streaming support. I would like to use it with streaming support.This one https://github.com/ml-explore/mlx-examples/blob/main/llms/mlx_lm/SERVER.md supports it and has MIT license.

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions