Skip to content

perf: export YOLO26 nano to ONNX or OpenVINO for the CPU pack #344

Description

@Abhash-Chakraborty

Summary

Keep YOLO26 nano as the quality baseline but evaluate exported CPU runtimes that avoid loading the full PyTorch/Ultralytics stack in the CPU pack.

Evidence

Find already configures yolo26n.pt, the current Ultralytics nano model. Official documentation reports YOLO26 supports ONNX, OpenVINO, LiteRT, CoreML, and other exports and improves CPU ONNX speed over YOLO11n: https://docs.ultralytics.com/models/yolo26

Where to work

Acceptance criteria

  • Export and validate YOLO26n ONNX and OpenVINO CPU candidates.
  • Measure artifact size, cold start, RAM, latency, and mAP/regression fixtures.
  • Compare FP32, FP16 where supported, and INT8 with calibration documentation.
  • Preserve the existing detected-object response contract.
  • Add provider fallback and corrupt/missing-artifact tests.
  • Recommend a CPU runtime only when quality loss stays within an agreed bound.

Out of scope

Do not replace YOLO26n with an older model merely because an export tutorial exists.

Metadata

Metadata

Assignees

Labels

assignedIssue or PR is already assigned to someone.backendFastAPI, database, storage, and API workenhancementNew feature, improvement, or enhancement request.gssoc26Related to GirlScript Summer of Code 2026.infraDocker, compose, deployment, and runtime setuplevel:advancedGSSoC difficulty level: advanced. Base contributor points: 55.mlModel inference, embeddings, OCR, captions, and search relevanceperformanceSpeed, startup, memory, image size, and runtime efficiencypriority: highImportant issue that should be handled soonstatus: unavailableThis issue is now unavailable to pick up.testingAutomated tests or manual QA coverage

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions