[Bug]: Get empty git diff after inference although the agent did some work #6407
Labels
bug
Something isn't working
evaluation
Related to running evaluations with OpenHands
Stale
Inactive for 30 days
Is there an existing issue for the same bug?
Describe the bug and reproduction steps
I am running the code of #4537 to try with the same code with the SWE-bench leaderboard (CodeAct v2.1).
For the first time, I got all empty git diffs. After I fix the code with the issue 4815, I can get some git diff but still have some empty git diff. And I found that there are some git diffs in invalid format.
Could you please help me on that to see what's going wrong? Or is there still some patches I need to get?
Besides, I would like to ask what max_iter is good from your experience. And do you have ever evaluated the cost of an average cost for SWE-Bench Lite leaderboard?
Thanks!
OpenHands Installation
Development workflow
OpenHands Version
CodeAct V2.1
Operating System
Linux
Logs, Errors, Screenshots, and Additional Context
logs.zip
The text was updated successfully, but these errors were encountered: