python3Packages.vllm: 0.6.2 -> 0.7.1

[prusnak]

This is a rebased PR #351805 with some of the changes from PR #359609 and should be viewed as the continuation of these two efforts

Things done

• Built on platform(s)
  • x86_64-linux
  • aarch64-linux
  • x86_64-darwin
  • aarch64-darwin
• For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
  • sandbox = relaxed
  • sandbox = true
• Tested, as applicable:
  • NixOS test(s) (look inside nixos/tests)
  • and/or package tests
  • or, for functions and "core" functionality, tests in lib/tests or pkgs/test
  • made sure NixOS tests are linked to the relevant packages
• Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage
• Tested basic functionality of all binary files (usually in ./result/bin/)
• 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
  • (Package updates) Added a release notes entry if the change is major or breaking
  • (Module updates) Added a release notes entry if the change is significant
  • (Module addition) Added a release notes entry if adding a new NixOS module
• Fits CONTRIBUTING.md.

---

Add a 👍 reaction to pull requests you find important.

[prusnak]

It seems that recent releases of vllm require xgrammar which is pain to build from source.

The PyPI provided wheels do not include aarch64-linux yet. Issue for inclusion of aarch64-linux wheels is here: mlc-ai/xgrammar#172

[prusnak]

The vllm now builds on my machine, but I cannot test it because I have an old GPU card (CC 5.2) :-/

[prusnak]

I am going to merge this as is now, but feel free to send any subsequent PRs @conroy-cheers @bgamari and tag me in them. I will review and possibly test.

Thank you again!

[prusnak]

It seems that recent releases of vllm require xgrammar which is pain to build from source.

Managed to do so in PR #379415 🎉