Issues

• Pin the remote ADD URLs in cicd/Dockerfile to a commit SHA

  Kaggle/kaggle-benchmarks#233 · Filter by author AUTHENSOR opened on Oct 18, 2026

• Timed-out tasks can persist COMPLETED run files after evaluation gives up

  Kaggle/kaggle-benchmarks#232 · Filter by author AUTHENSOR opened on Oct 18, 2026

• DockerEnvironment bind mount is inverted: host /tmp mounted read-write into the container

  Kaggle/kaggle-benchmarks#231 · Filter by author AUTHENSOR opened on Oct 18, 2026

• assert_tool_was_invoked counts invocations that errored

  Kaggle/kaggle-benchmarks#230 · Filter by author AUTHENSOR opened on Oct 18, 2026

• Score-type tasks pass on any return value; truthy returns crash the console formatter; BaseException is swallowed

  Kaggle/kaggle-benchmarks#229 · Filter by author AUTHENSOR opened on Oct 18, 2026

• assess_response_with_judge: unfenced model text in the judge prompt, and judge errors score as vacuous passes

  Kaggle/kaggle-benchmarks#228 · Filter by author AUTHENSOR opened on Oct 18, 2026

• Cached runs report passed=True and drop recorded assertions

  Kaggle/kaggle-benchmarks#227 · Filter by author AUTHENSOR opened on Oct 18, 2026

• [Bug]: Outragous queue time for TPU

  bug
  Kaggle/kaggle-benchmarks#226 · Filter by author glook9001 opened on Oct 17, 2026
  2

• [feature request]: Support prompt caching parameters

  enhancement
  Kaggle/kaggle-benchmarks#173 · Filter by author anpc849 opened on Jun 17, 2026
  3

• [Bug]: Bokeh frontend render error only in Kaggle saved notebook history preview

  bug
  Kaggle/kaggle-benchmarks#171 · Filter by author 14790897 opened on Jun 5, 2026