Skip to content

Conversation

@neubig
Copy link
Contributor

@neubig neubig commented Sep 26, 2025

  • This change is worth documenting at https://docs.all-hands.dev/
  • Include this change in the Release Notes. If checked, you must provide an end-user friendly description for your change below

End-user friendly description of the problem this fixes or functionality this introduces.

This adds SWE-gym modal eval to swe bench.


Summarize what the PR does, explaining any non-trivial design decisions.


Link of any specific issues this addresses:


To run this PR locally, use the following command:

GUI with Docker:

docker run -it --rm   -p 3000:3000   -v /var/run/docker.sock:/var/run/docker.sock   --add-host host.docker.internal:host-gateway   -e SANDBOX_RUNTIME_CONTAINER_IMAGE=docker.all-hands.dev/all-hands-ai/runtime:540acf3-nikolaik   --name openhands-app-540acf3   docker.all-hands.dev/all-hands-ai/openhands:540acf3

CLI with uvx:

uvx --python 3.12 --from git+https://github.com/All-Hands-AI/OpenHands@add-swe-gym-modal-eval openhands

@openhands-ai
Copy link

openhands-ai bot commented Sep 26, 2025

Looks like there are a few issues preventing this PR from being merged!

  • GitHub Actions are failing:
    • Docker
    • Run Python Tests

If you'd like me to help, just leave a comment, like

@OpenHands please fix the failing actions on PR #11146 at branch `add-swe-gym-modal-eval`

Feel free to include any additional details that might help me get this PR into a better state.

You can manage your notification settings

@github-actions
Copy link
Contributor

Coverage report

This PR does not seem to contain any modification to coverable code.

@neubig
Copy link
Contributor Author

neubig commented Oct 16, 2025

@OpenHands fix the conflicts in poetry.lock

@openhands-ai
Copy link

openhands-ai bot commented Oct 16, 2025

I'm on it! neubig can track my progress at all-hands.dev

@neubig neubig changed the title [DRAFT] Update dependency for swe gym modal eval Update dependency for swe gym modal eval Oct 16, 2025
@neubig neubig marked this pull request as ready for review October 16, 2025 14:33
@neubig neubig requested a review from ryanhoangt October 16, 2025 14:33
Resolved poetry.lock conflicts by regenerating lock file
@openhands-ai
Copy link

openhands-ai bot commented Oct 16, 2025

Summary

I've successfully resolved the merge conflict in poetry.lock for PR #11146 on the add-swe-gym-modal-eval branch. Here's what was done:

Changes Made:

  1. Merged main branch into add-swe-gym-modal-eval
  2. Resolved poetry.lock conflict by:
    • Removing the conflicted poetry.lock file
    • Regenerating it using poetry lock to ensure it matches the current pyproject.toml
  3. Committed and pushed the merge to the remote branch

Result:

  • ✅ The branch now includes all updates from main (version bump to 0.59.0, new dependencies like playwright, libtmux updates, V1 dependencies, etc.)
  • ✅ The poetry.lock file is now properly synchronized with pyproject.toml
  • ✅ The branch maintains its SWE-gym dependency configuration: swebench = { git = "https://github.com/neubig/SWE-bench.git", rev = "add-swe-gym-dependencies" }
  • ✅ Changes have been pushed to the remote branch, updating PR Update dependency for swe gym modal eval #11146

The merge conflict has been completely resolved, and the PR is now ready for the CI checks to run again.

View full conversation

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants