Skip to content

[Super 3.5 evals] Update Sep 26, 2026 - #3702

Merged
bxyu-nvidia merged 6 commits into
mainfrom
bxyu/super-3.5-evals-20260926
Sep 27, 2026
Merged

bxyu-nvidia merged 6 commits into
mainfrom
bxyu/super-3.5-evals-20260926

Conversation

@bxyu-nvidia

@bxyu-nvidia bxyu-nvidia commented Sep 26, 2026 •

Copy link
Copy Markdown
Contributor

What does this PR do?

  1. Add new model configs: benchmarks/nemotron_3.5_super/vllm_configs/*.sh
  2. OpenSandbox HTTP transport respects retry-after header: nemo_gym/sandbox/providers/_http_transport.py, tests/unit_tests/test_opensandbox_http_transport.py
  3. OpenCode agent defaults to 1hr timeout: responses_api_agents/opencode_sandboxed_agent/configs/opencode_sandboxed_agent.yaml, responses_api_agents/opencode_sandboxed_agent/app.py

Validation

Rollouts

Compatibility and benchmark impact

Checklist

  • I have read the contributing guidelines.
  • The change is focused; unrelated "drive-by" edits are tracked as separate issues/PRs.
  • Tests added or updated and pass locally, or N/A for docs-only / non-code changes (so CI unit/server checks pass when applicable).
  • Documentation added or updated, or N/A with justification.
  • Pre-commit checks pass locally (pre-commit run --all-files) (so CI lint/format checks pass).
  • New source files include the required Apache-2.0 SPDX header.
  • All commits have DCO sign-off (git commit -s) (so the DCO check passes).

Signed-off-by: Brian Yu <bxyu@nvidia.com>
Signed-off-by: Brian Yu <bxyu@nvidia.com>
Signed-off-by: Brian Yu <bxyu@nvidia.com>
@nemo-automation-bot
nemo-automation-bot Bot requested a review from a team September 26, 2026 23:38
@nemo-automation-bot
nemo-automation-bot Bot requested a review from a team September 26, 2026 23:39
Signed-off-by: Brian Yu <bxyu@nvidia.com>
@bxyu-nvidia

Copy link
Copy Markdown
Contributor Author

/ok to test 1f43270

Signed-off-by: Brian Yu <bxyu@nvidia.com>
@bxyu-nvidia

Copy link
Copy Markdown
Contributor Author

/ok to test 2c2f3be

@yaoyu-33 yaoyu-33 added area:orchestration Job submission, deployment, services, and lifecycle management complexity:high Cross-component or shared-contract change with a large review surface feature New capabilities, enhancements, or enablement work needs-review PR is ready for code review and waiting on a reviewer labels Sep 27, 2026
Signed-off-by: Brian Yu <bxyu@nvidia.com>
@bxyu-nvidia
bxyu-nvidia merged commit ef0fce4 into main Sep 27, 2026
41 checks passed
@bxyu-nvidia
bxyu-nvidia deleted the bxyu/super-3.5-evals-20260926 branch September 27, 2026 05:55

This branch was successfully deployed

1 active deployment
public — 6e0673bb Deployed Sep 27, 2026 by copy-pr-bot[bot] via release / finalize / notify #3651
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area:orchestration Job submission, deployment, services, and lifecycle management complexity:high Cross-component or shared-contract change with a large review surface feature New capabilities, enhancements, or enablement work needs-review PR is ready for code review and waiting on a reviewer

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants