Skip to content

chore(main): release 1.10.0 - #440

Merged
wangauone merged 1 commit into
mainfrom
release-please--branches--main--components--evalbench
Jul 14, 2026
Merged

chore(main): release 1.10.0#440
wangauone merged 1 commit into
mainfrom
release-please--branches--main--components--evalbench

Conversation

@release-please

@release-please release-please Bot commented Jun 18, 2026

Copy link
Copy Markdown
Contributor

🤖 I have created a release beep boop

1.10.0 (2026-07-13)

Features

  • add 300-second timeout to QueryData API calls to prevent indefinite blocking (76c7ca4)
  • Add ability to filter to specific json scenario/examples (#453) (7c99d3d)
  • Add hybrid evaluation Python notebook (#487) (ace0149)
  • dea: adjust conversation turns and plan for programmatic scenarios (#479) (7434a91)
  • dea: adjust conversation turns and plan for programmatic scenarios (#479) (85b90ec)
  • dea: implement GCS archival for DataEngineeringAgent (#476) (5e36350)
  • dea: implement GCS archival for DataEngineeringAgent (#476) (89c24e4)
  • dea: support dynamic workspace environment files mapping and injection (#491) (a409608)
  • dea: support dynamic workspace lifecycle and parameter passing in evaluator, generator, and scorers (#474) (b5e97f0)
  • dea: support dynamic workspace lifecycle and parameter passing in evaluator, generator, and scorers (#474) (94b63ae)
  • dea: support static workspaces (Mode 2) and update README (#486) (39cb2b8)
  • mcp-readability: add MCP tool man-page formatter (620cc0b)
  • mcp-readability: add MCP tool man-page formatter (3e4c16e)
  • mcp-readability: add McpToolsGenerator with pluggable tools_source (66b67d5)
  • mcp-readability: add sample run config, endpoints, style guide, exceptions (a21ec5e)
  • mcp-readability: compliance orchestrator, LLM judge, and metrics scorer (52ffade)
  • mcp-readability: compliance orchestrator, LLM judge, and metrics scorer (fefb034)
  • mcp-readability: compliance orchestrator, LLM judge, and metrics scorer (222fd49)
  • natively copy declared env_files to agent sandbox (#434) (db4e5b8)
  • query_data_api: support api_endpoint override in model config (#480) (3f1868c)
  • query_data_api: support api_endpoint override in model config (#480) (0d59e90)
  • Support cross-database evaluation with SQLite ground truth (#465) (e71692c)
  • Support cross-database evaluation with SQLite ground truth (#465) (3cb207b)
  • util: add DataformHelper utility for managing cloud sandboxes and mock-based unit tests (#458) (aa1642a)
  • util: update DataformHelper utility with high-level workspace lifecycle methods (#466) (9a75a7a)

Bug Fixes

  • add timeout to data agent request in querydata generator (a8b148e)
  • add timeout to data agent request in querydata generator (9573c14)
  • agy_cli: drop unsupported -- delimiter from plugin install (4f55589)
  • agy_cli: drop unsupported -- delimiter from plugin install (87f0945)
  • dataform: synchronize GCP project env vars in dataform scorer (a15a54f)
  • dataform: synchronize GCP project env vars in dataform scorer (de7dc22)
  • dataform: synchronize GCP project env vars in dataform scorer (be31ac6)
  • dataset: load all knowledge-base entries, not just the last line (b8b96c8)
  • dataset: load all knowledge-base entries, not just the last line (63441ce)
  • dea: accumulate all agent text parts and increase timeout (#456) (cf3f758)
  • deps: add mcp to pyproject.toml dependencies (62c7436)
  • deps: add mcp to pyproject.toml dependencies (5928137)
  • interact: count total_db_len so DB-setup progress isn't always zero (#446) (0d66535)
  • log metadata reflection failures instead of swallowing them (cce4eb2)
  • log metadata reflection failures instead of swallowing them (fa3c508)
  • make: eliminate container name race in container/shell targets (#449) (8f1803d)
  • re-raise 404 as bare HTTPError instead of ResourceExhaustedError (3307570)
  • re-raise 404 errors in querydata generate_internal (7a2bf1f)
  • re-raise 404 errors in querydata generate_internal (b7f7b30)
  • reporting: Add retry logic and configurable chunk size for BigQuery writes (6b5f0a6)
  • reporting: Add retry logic and configurable chunk size for BigQuery writes (8774d02)
  • restrict unpickling of cached results to safe types (#439) (067dfe3)
  • scorers: correct digit regex in behavioral metrics scorer (78ecdfc)
  • scorers: correct digit regex in behavioral metrics scorer (c8d82ea)
  • tight copy of claude settings from local environment (#467) (474a9be)

This PR was generated with Release Please. See documentation.

@release-please
release-please Bot requested a review from IsmailMehdi as a code owner June 18, 2026 07:50
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 3 times, most recently from a9f327b to 4d1ac26 Compare June 19, 2026 05:27
@release-please release-please Bot changed the title chore(main): release 1.9.1 chore(main): release 1.10.0 Jun 19, 2026
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 10 times, most recently from 8823a27 to f9322a6 Compare June 26, 2026 02:30
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 6 times, most recently from da23716 to d5f6d66 Compare July 2, 2026 00:47
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 7 times, most recently from 2f12ade to e0886ae Compare July 9, 2026 05:08
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 3 times, most recently from afbda6a to 06fd787 Compare July 9, 2026 15:50
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch 3 times, most recently from c394f33 to 0b1265f Compare July 13, 2026 15:48
@release-please
release-please Bot force-pushed the release-please--branches--main--components--evalbench branch from 0b1265f to 3ba4296 Compare July 13, 2026 21:24
@wangauone

Copy link
Copy Markdown
Collaborator

/gcbrun

@wangauone
wangauone merged commit 2e71a59 into main Jul 14, 2026
11 checks passed
@release-please

Copy link
Copy Markdown
Contributor Author

🤖 Created releases:

🌻

g-lynnzee pushed a commit to g-lynnzee/evalbench that referenced this pull request Jul 19, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant