Skip to content

MBPP+ benchmark: sandbox, dataset with plus asserts, runner and llama3.2 results #23

MBPP+ benchmark: sandbox, dataset with plus asserts, runner and llama3.2 results

MBPP+ benchmark: sandbox, dataset with plus asserts, runner and llama3.2 results #23

Triggered via pull request September 9, 2026 19:42
Status Failure
Total duration 1m 9s
Artifacts –

ci.yml

on: pull_request
API (ruff, mypy, pytest)
13s
API (ruff, mypy, pytest)
Web (tsc, build)
1m 5s
Web (tsc, build)
Fit to window
Zoom out
Zoom in

Annotations

1 error and 2 warnings
API (ruff, mypy, pytest)
Process completed with exit code 1.
API (ruff, mypy, pytest)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, astral-sh/setup-uv@v5. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/
Web (tsc, build)
Node.js 20 is deprecated. The following actions target Node.js 20 but are being forced to run on Node.js 24: actions/checkout@v4, actions/setup-node@v4. For more information see: https://github.blog/changelog/2025-09-19-deprecation-of-node-20-on-github-actions-runners/