Evaluation new models

[elmoBG8]

Hello, I see you added new supported models. Can you provide an evaluation of them on SWE-bench so that it can be compared with the evaluations already done?

Thank you

[qrdlgit]

Yes, the entire engineering world is holding their breath :)

SWE-bench is probably the best eval out there right now, and this is one of the best ways to evaluate swe-bench!