Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Get empty git diff after inference although the agent did some work #6407

Closed
1 task done
tangken333 opened this issue Jan 22, 2025 · 2 comments
Closed
1 task done
Labels
bug Something isn't working evaluation Related to running evaluations with OpenHands Stale Inactive for 30 days

Comments

@tangken333
Copy link

Is there an existing issue for the same bug?

  • I have checked the existing issues.

Describe the bug and reproduction steps

I am running the code of #4537 to try with the same code with the SWE-bench leaderboard (CodeAct v2.1).

For the first time, I got all empty git diffs. After I fix the code with the issue 4815, I can get some git diff but still have some empty git diff. And I found that there are some git diffs in invalid format.

Could you please help me on that to see what's going wrong? Or is there still some patches I need to get?

Besides, I would like to ask what max_iter is good from your experience. And do you have ever evaluated the cost of an average cost for SWE-Bench Lite leaderboard?

Thanks!

OpenHands Installation

Development workflow

OpenHands Version

CodeAct V2.1

Operating System

Linux

Logs, Errors, Screenshots, and Additional Context

logs.zip

Image

@tangken333 tangken333 added the bug Something isn't working label Jan 22, 2025
@mamoodi mamoodi added the evaluation Related to running evaluations with OpenHands label Jan 22, 2025
Copy link
Contributor

This issue is stale because it has been open for 30 days with no activity. Remove stale label or comment or this will be closed in 7 days.

@github-actions github-actions bot added the Stale Inactive for 30 days label Feb 22, 2025
Copy link
Contributor

github-actions bot commented Mar 1, 2025

This issue was closed because it has been stalled for over 30 days with no activity.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale Mar 1, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working evaluation Related to running evaluations with OpenHands Stale Inactive for 30 days
Projects
None yet
Development

No branches or pull requests

2 participants