Skip to content

Commit 372d226

Browse files
committed
feat(swe-dataset-factory): vendor DeepSWE real_pr factory and N=20 product
Ship the swe-factory package, unit tests, small fixtures, and certified DeepSWE Real-PR N=20 product packs under swe-dataset-factory/ as a clean subproject (no clash with src/swe_forge). Document the path and eval-deepswe entry in the root README; unignore product jsonl/json.
1 parent 5f674e3 commit 372d226

984 files changed

Lines changed: 226369 additions & 2 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.gitignore

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -92,3 +92,16 @@ tasks-*/
9292
*.jsonl
9393
test-output/
9494
*.log
95+
96+
# Vendored deepswe product under swe-dataset-factory/ (keep product evidence)
97+
!swe-dataset-factory/
98+
!swe-dataset-factory/**
99+
!swe-dataset-factory/**/*.jsonl
100+
!swe-dataset-factory/**/*.json
101+
!swe-dataset-factory/**/*.md
102+
# still never commit subproject secrets or caches
103+
swe-dataset-factory/.env
104+
swe-dataset-factory/.venv/
105+
swe-dataset-factory/**/__pycache__/
106+
swe-dataset-factory/**/node_modules/
107+
swe-dataset-factory/fixtures/harbor_motors/.ts_deps/

README.md

Lines changed: 30 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@
44

55
**Real-code software engineering benchmarks for Platform agents**
66

7-
[![License](https://img.shields.io/github/license/PlatformNetwork/Agent-SWE)](https://github.com/PlatformNetwork/Agent-SWE/blob/main/LICENSE)
7+
[![License](https://img.shields.io/github/license/BaseIntelligence/Agent-SWE)](https://github.com/BaseIntelligence/Agent-SWE/blob/main/LICENSE)
88
[![Platform SDK](https://img.shields.io/badge/Platform-SDK-black)](https://github.com/PlatformNetwork/platform)
99
[![Python](https://img.shields.io/badge/python-3.12+-blue.svg)](https://www.python.org/)
1010
[![SWE-Forge](https://img.shields.io/badge/SWE--Forge-CortexLM-blue)](https://huggingface.co/datasets/CortexLM/swe-forge)
@@ -64,7 +64,7 @@ flowchart LR
6464
## Install
6565

6666
```bash
67-
git clone https://github.com/PlatformNetwork/Agent-SWE.git
67+
git clone https://github.com/BaseIntelligence/Agent-SWE.git
6868
cd Agent-SWE
6969
pip install -e ".[dev]"
7070
```
@@ -208,9 +208,37 @@ Agent-SWE/
208208
│ ├── export/
209209
│ ├── swe/
210210
│ └── synthetic/
211+
├── swe-dataset-factory/ # DeepSWE Real-PR product + factory (subproject)
211212
└── tests/
212213
```
213214

215+
## DeepSWE Real-PR factory (`swe-dataset-factory/`)
216+
217+
Agent-SWE also vendors the **SWE Dataset Factory** under [`swe-dataset-factory/`](swe-dataset-factory/): a separate package that ships Docker-verifiable DeepSWE / Harbor packs from live-mined public PRs.
218+
219+
| Surface | Path | Role |
220+
|---|---|---|
221+
| Product N=20 | `swe-dataset-factory/datasets/deepswe_v1/` | Certified Real-PR packs (`source_track=real_pr`) |
222+
| Seed archive | `swe-dataset-factory/datasets/deepswe_v1_seed5_archive/` | Historical seed5 only |
223+
| Soft panel | `swe-dataset-factory/datasets/panel_deepswe_5pack/` | Report JSON evidence |
224+
| CLI package | `swe-dataset-factory/src/swe_factory/` | `swe-factory` entrypoint |
225+
226+
Install and use from the subproject (Python >= 3.12):
227+
228+
```bash
229+
cd swe-dataset-factory
230+
pip install -e ".[dev]"
231+
cp .env.example .env # never commit .env
232+
233+
# DeepSWE-grade Pier + mini-swe serial eval (product root N=20)
234+
swe-factory eval-deepswe --product-root datasets/deepswe_v1 --help
235+
```
236+
237+
Details, ship commands, and honesty boundaries live in
238+
[`swe-dataset-factory/README.md`](swe-dataset-factory/README.md).
239+
Forge mining (`swe-forge` under `src/`) remains the existing Agent-SWE path;
240+
the factory is a clean subproject so it does not clash with `src/swe_forge`.
241+
214242
## Platform Integration
215243

216244
Agent-SWE is designed to feed Platform challenge validators with deterministic repository-repair tasks. Validators can sample tasks, run agent patches in isolated workspaces, and turn task completion rates into raw challenge scores for Platform.

swe-dataset-factory/.env.example

Lines changed: 19 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,19 @@
1+
# OpenRouter (required for live teacher/panel stages)
2+
OPENROUTER_API_KEY=sk-or-v1-replace-me
3+
OPENROUTER_BASE_URL=https://openrouter.ai/api/v1
4+
5+
# Models — OpenRouter ids only
6+
FACTORY_TEACHER_MODEL=anthropic/claude-opus-4.8
7+
# Real-PR wave panel pair (VAL-RPANEL-001); Opus optional / not required.
8+
FACTORY_PANEL_MODELS=x-ai/grok-4.5,moonshotai/kimi-k2.6
9+
10+
# Hard spend cap (exact + unresolved reserved must stay under this)
11+
FACTORY_BUDGET_USD=600
12+
13+
# Optional GitHub token for PR mining rate limits
14+
# GITHUB_TOKEN=
15+
16+
# Oxylabs Web Scraper API (required for live GitHub HTTP page/raw fetches)
17+
# Always uses source=universal only; never amazon/marketplace templates.
18+
# OXYLABS_USERNAME=
19+
# OXYLABS_PASSWORD=

swe-dataset-factory/.gitignore

Lines changed: 52 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,52 @@
1+
# Python
2+
__pycache__/
3+
*.py[cod]
4+
*$py.class
5+
*.egg-info/
6+
.eggs/
7+
dist/
8+
build/
9+
.mypy_cache/
10+
.ruff_cache/
11+
.pytest_cache/
12+
.coverage
13+
htmlcov/
14+
.venv/
15+
venv/
16+
*.egg
17+
18+
# Secrets and local env
19+
.env
20+
.env.local
21+
*.pem
22+
23+
# Local documentation / validation evidence (never publish)
24+
.docs-evidence/
25+
26+
# Generated work caches and bulk non-product datasets (not vendored here)
27+
datasets/_clone_cache/
28+
datasets/_work*/
29+
datasets/sdf-ship-*/
30+
datasets/mine_allowlist*/
31+
datasets/real_pr_pool_live_*/
32+
datasets/_div_probe/
33+
datasets/_ship_work*/
34+
datasets/live_materials/
35+
datasets/micro_keep_*/
36+
datasets/ut_*/
37+
38+
# Harbor motor dual-run jest node_modules cache (local only)
39+
fixtures/harbor_motors/.ts_deps/
40+
**/node_modules/
41+
42+
# OS / editor
43+
.DS_Store
44+
.idea/
45+
.vscode/
46+
*.swp
47+
*~
48+
49+
# Docker / runtime
50+
*.log
51+
tmp/
52+
.cache/

0 commit comments

Comments
 (0)