ci: probe experimental backends (windows-rocm, sycl, openvino)#50
Open
worthant wants to merge 5 commits into
Open
ci: probe experimental backends (windows-rocm, sycl, openvino)#50worthant wants to merge 5 commits into
worthant wants to merge 5 commits into
Conversation
Promote dev to master: sched split-input fix for Gemma 4 E-series
Build probes to see whether these backends compile in this fork. Not wired into any release — triggered on dispatch and on changes to this file only, so unrelated PRs don't pay the cost. Honesty about what each delivers: - windows-x64-rocm: REAL turbo (kernels are RDNA-aware); probes whether MSVC + hipcc cooperate. HIP SDK version is a guess and may need a bump. - linux-x64-sycl (fp16/fp32): COMPATIBILITY ONLY — no turbo kernels for SYCL, so plain llama.cpp on Intel GPUs. - linux-x64-openvino: COMPATIBILITY ONLY — graph-offload backend, custom KV quant types don't map onto it.
…heRock - openvino: install ocl-icd-opencl-dev + opencl-headers (build failed with 'Could NOT find OpenCL') - windows-rocm: the EULA-gated PRO-Edition installer URL is dead (404); use TheRock's portable ROCm dist (own clang toolchain) instead, building the RDNA3 gfx110X family as the probe representative
TheRock clang toolchain is found and configuring now; GGML_BACKEND_DL guards on BUILD_SHARED_LIBS, which defaults ON on Linux but not in this Windows+Ninja setup. Explicit flag. (Linux ROCm job unaffected — same as the passing CUDA/Vulkan jobs.)
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Build probes to answer "do these even compile in this fork?" — not wired into any release. Triggered only on dispatch and on changes to the probe file itself, so unrelated PRs don't pay the cost. Opening this PR runs all three once.
What each would actually deliver (read before celebrating a green check)
Known sharp edges (the probe may fail at these — that's the finding)
HIP_SDK_VERSION: 6.2.4is a guess; if the installer 404s orHIP_PATHis wrong, we bump to a currently-published "For HIP SDK" build.Decision this PR informs
Whether to invest in Windows ROCm (likely yes — real feature) vs. SYCL/OpenVINO (only if a turbo-less Intel path has product value, or after we port turbo kernels to SYCL — a multi-week effort). Do not merge to keep permanently until we've read the results and decided per-backend.