Port NInfer to RTX 4090 and Qwen3.6-27B - #1
Merged
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
sm_86to RTX 4090sm_89on LinuxAttribution and contribution boundary
This is a maintained port of Don-Chad/ninfer-3090, derived from Neroued/ninfer. MTP, CUDA Graphs, the
.ninferartifact format, C++ Engine API, CLI, and OpenAI/Anthropic-compatible server are inherited capabilities.The contribution in this branch is the
sm_89architecture port, RTX 4090 GDN dispatch, retained Q5 optimization, 27B-only product specialization, tests, benchmark evidence, documentation, and public maintenance setup.Verification
tests/artifact,tests/test_bench_matrix.py)464e2d6Release note
This is a source-only public release. No model weights, binaries, builds, profiles, request logs, credentials, or raw Nsight traces are included. The stored GPU results are historical qualification evidence; no post-sanitization CUDA binary is claimed as validated.