Skip to content

chore: release v2.0.0-rc2 - #343

Merged
olearycrew merged 1 commit into
mainfrom
release/v2.0.0-rc2
Apr 22, 2026
Merged

chore: release v2.0.0-rc2#343
olearycrew merged 1 commit into
mainfrom
release/v2.0.0-rc2

Conversation

@ScuttleBot

Copy link
Copy Markdown
Contributor

PinchBench 2.0.0-rc2

First release candidate of PinchBench 2.0.

Major Changes in 2.0

Task Organization

  • Task categorization system — tasks organized into logical categories:
    • productivity, research, writing, coding, analysis
    • csv_analysis, log_analysis, meeting_analysis
    • memory, skills, integrations
  • run_first directive for ensuring critical tasks execute first

Multi-Session Support

  • new_session: true flag for session isolation testing
  • Transcript archiving across session boundaries
  • Tests cross-session memory and file-based context retrieval

New Tasks (74+)

  • CSV Analysis: stock trends, temperature data, life expectancy, GDP, iris flowers, cities, pension funds
  • Log Analysis: Apache error logs, syslog boot analysis
  • Meeting Analysis: council meetings, tech discussions, advisory boards, government hearings
  • Research: deep research, competitive analysis, OSS alternatives, pricing, procurement
  • Coding: CI/CD debugging, test generation, K8s debugging, browser automation

Infrastructure

  • Enhanced grading library with better edge case handling
  • Improved lint checks for manifest validation
  • Better transcript handling and merging for multi-session tasks

Checklist

  • BENCHMARK_VERSION updated to 2.0.0-rc2
  • All tasks categorized in manifest
  • CI passing

@kilo-code-bot

kilo-code-bot Bot commented Apr 21, 2026

Copy link
Copy Markdown
Contributor

Code Review Summary

Status: No Issues Found | Recommendation: Merge

This PR bumps the benchmark version to 2.0.0-rc2. The latest commits moved BENCHMARK_VERSION from scripts/ to the repo root and updated its value — a straightforward housekeeping change with no bugs or security concerns.

Files Reviewed (2 files)
  • BENCHMARK_VERSION
  • scripts/BENCHMARK_VERSION (deleted)

Reviewed by claude-sonnet-4.6 · 60,622 tokens

First release candidate of PinchBench 2.0.

Major changes in 2.0:
- Task categorization system (productivity, research, writing, coding, analysis, csv_analysis, log_analysis, meeting_analysis, memory, skills, integrations)
- Multi-session support with new_session:true for session isolation
- 74+ new tasks across all categories
- Enhanced grading library
- Improved transcript handling and archiving
@olearycrew
olearycrew merged commit 9ea5ccf into main Apr 22, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants