test: add GPU end-to-end CI coverage - #2662
Open
balasaajay wants to merge 3 commits into
Open
Conversation
Exercise the packaged CLI and isolated Gym components through deterministic CPU tool use. Add a configurable GPU smoke lane for external vLLM runners. Signed-off-by: Ananth Subramaniam <ansubramania@nvidia.com>
…n and artifact uploads - Added optional inputs for model name, model revision, Hugging Face cache path, and results path in the test template action. - Updated GPU E2E workflow to utilize the new model configuration and upload test artifacts. - Removed obsolete CPU E2E workflow and related scripts. - Enhanced GPU E2E test script to handle new parameters and validate outputs against expected results. Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
…riables - Removed the optional Hugging Face cache path input from the test template action. - Updated the GPU E2E workflow to eliminate references to the Hugging Face cache path. - Modified the GPU E2E test script to use the new HF_HOME environment variable instead of HF_CACHE_DIR. - Adjusted volume mounts and environment variables in the action and test script for improved clarity and functionality. Signed-off-by: Ajay Balasa <abalasa@nvidia.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What does this PR do?
Adds an end-to-end GPU test using the infrastructure introduced in #2630 and the test foundation from #2575.
The test exercises:
Qwen on GPU → vLLM → Gym model server → simple agent → string_match verifier
Qwen/Qwen2.5-0.5B-Instructat a pinned Hugging Face revision.0.1.0, uses the expected model, and contains valid token usage and output.Checklist
pre-commit run --all-files) (so CI lint/format/copyright pass).git commit -s) (so the DCO check passes).