Skip to content

Add OpenVINO GenAI C runtime for Voxtype NPU support - #64

Draft
jacob-vincent-mink wants to merge 3 commits into
omacom:masterfrom
jacob-vincent-mink:feature/openvino-genai
Draft

Add OpenVINO GenAI C runtime for Voxtype NPU support#64
jacob-vincent-mink wants to merge 3 commits into
omacom:masterfrom
jacob-vincent-mink:feature/openvino-genai

Conversation

@jacob-vincent-mink

@jacob-vincent-mink jacob-vincent-mink commented Mar 25, 2026

Copy link
Copy Markdown
Contributor

Summary

  • add Spencer Bull’s source-built openvino-genai package
  • update it to OpenVINO GenAI 2026.3.1.0 and require Arch openvino=2026.3.1
  • ship libopenvino_genai_c.so, which Voxtype 1.1’s runtime-loaded OpenVINO backend requires
  • use Arch’s official openvino-intel-npu-plugin; it pulls the current intel-npu-driver and compiler
  • advertise the GenAI runtime and NPU plugin from voxtype-bin
  • backport upstream OpenVINO GenAI 398fbc14 to fix an unresolved format<int> symbol and add a package-time C ABI load check

Validation

  • official package build completed and contained the expected GenAI, tokenizer, and GenAI C shared libraries
  • ldd -r and ctypes.CDLL("libopenvino_genai_c.so") exposed the upstream linkage bug; both pass with the backport
  • Voxtype 1.1.0-rc4 downloaded a fresh OpenVINO model, compiled its NPU cache, and transcribed a WAV on a real Intel NPU with device=NPU and no fallback
  • repository self-tests pass

Release sequencing

Keep draft until the fixed pkgrel=2 artifact is produced by the official builder and voxtype-bin 1.1.0 is released.

Co-authored package work from @spencerbull.

@spencerbull

spencerbull commented Mar 26, 2026

Copy link
Copy Markdown
Contributor

LGTM after we update the sha

@jacob-vincent-mink
jacob-vincent-mink marked this pull request as draft March 26, 2026 01:39
@jacob-vincent-mink
jacob-vincent-mink force-pushed the feature/openvino-genai branch 2 times, most recently from 28ab3a6 to 957a829 Compare March 26, 2026 02:51
@jacob-vincent-mink
jacob-vincent-mink marked this pull request as ready for review March 26, 2026 02:51
@jacob-vincent-mink

Copy link
Copy Markdown
Contributor Author

LGTM after we update the sha

done

@spencerbull

Copy link
Copy Markdown
Contributor

still having group issues to access /dev/accel/accel0

@spencerbull

Copy link
Copy Markdown
Contributor

@jacob-vincent-mink can you provide an update on what we're waiting on here

@jacob-vincent-mink jacob-vincent-mink changed the title Create intel openvino genai and npu driver packages Add OpenVINO GenAI C runtime for Voxtype NPU support Sep 4, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants