Pinned Loading

1. fastapi_tritonserver fastapi_tritonserver Public

   Python 28 6

2. MeloTTS-OV MeloTTS-OV Public

   Using OpenVINO to speed up MeloTTS inference

   Python 15 3

3. Tlntin/Qwen-TensorRT-LLM Tlntin/Qwen-TensorRT-LLM Public

   Python 623 57

4. openvino_backend_ov_2022 openvino_backend_ov_2022 Public

   Optimized the OpenVINO backend to significantly enhance performance for search and recommendation models, particularly in scenarios involving a high volume of model input number.

   C++

5. ollama_ov ollama_ov Public

   Add genai backend for ollama to run generative AI models using OpenVINO Runtime.

   Go 18 1

6. paddleocr_vl_ov paddleocr_vl_ov Public

   Using OpenVINO to speed up inference of PaddleOCR-VL model

   Python 7 1