Skip to content

Commit 871b67a

Browse files
committed
refactor(deepagent): rebrand DeepSWE product and eval to DeepAgent
Rename product surfaces, CLI primary names, docker mintags, and the vendored factory folder to DeepAgent while keeping hidden deepswe CLI aliases for compatibility.
1 parent 372d226 commit 871b67a

1,054 files changed

Lines changed: 15232 additions & 15224 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

‎.gitignore‎

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -93,15 +93,15 @@ tasks-*/
9393
test-output/
9494
*.log
9595

96-
# Vendored deepswe product under swe-dataset-factory/ (keep product evidence)
97-
!swe-dataset-factory/
98-
!swe-dataset-factory/**
99-
!swe-dataset-factory/**/*.jsonl
100-
!swe-dataset-factory/**/*.json
101-
!swe-dataset-factory/**/*.md
96+
# Vendored deepagent product under deepagent/ (keep product evidence)
97+
!deepagent/
98+
!deepagent/**
99+
!deepagent/**/*.jsonl
100+
!deepagent/**/*.json
101+
!deepagent/**/*.md
102102
# still never commit subproject secrets or caches
103-
swe-dataset-factory/.env
104-
swe-dataset-factory/.venv/
105-
swe-dataset-factory/**/__pycache__/
106-
swe-dataset-factory/**/node_modules/
107-
swe-dataset-factory/fixtures/harbor_motors/.ts_deps/
103+
deepagent/.env
104+
deepagent/.venv/
105+
deepagent/**/__pycache__/
106+
deepagent/**/node_modules/
107+
deepagent/fixtures/harbor_motors/.ts_deps/

‎README.md‎

Lines changed: 11 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -208,34 +208,34 @@ Agent-SWE/
208208
│ ├── export/
209209
│ ├── swe/
210210
│ └── synthetic/
211-
├── swe-dataset-factory/ # DeepSWE Real-PR product + factory (subproject)
211+
├── deepagent/ # DeepAgent Real-PR product + factory (subproject)
212212
└── tests/
213213
```
214214

215-
## DeepSWE Real-PR factory (`swe-dataset-factory/`)
215+
## DeepAgent Real-PR factory (`deepagent/`)
216216

217-
Agent-SWE also vendors the **SWE Dataset Factory** under [`swe-dataset-factory/`](swe-dataset-factory/): a separate package that ships Docker-verifiable DeepSWE / Harbor packs from live-mined public PRs.
217+
Agent-SWE also vendors the **SWE Dataset Factory** under [`deepagent/`](deepagent/): a separate package that ships Docker-verifiable DeepAgent / Harbor packs from live-mined public PRs.
218218

219219
| Surface | Path | Role |
220220
|---|---|---|
221-
| Product N=20 | `swe-dataset-factory/datasets/deepswe_v1/` | Certified Real-PR packs (`source_track=real_pr`) |
222-
| Seed archive | `swe-dataset-factory/datasets/deepswe_v1_seed5_archive/` | Historical seed5 only |
223-
| Soft panel | `swe-dataset-factory/datasets/panel_deepswe_5pack/` | Report JSON evidence |
224-
| CLI package | `swe-dataset-factory/src/swe_factory/` | `swe-factory` entrypoint |
221+
| Product N=20 | `deepagent/datasets/deepagent_v1/` | Certified Real-PR packs (`source_track=real_pr`) |
222+
| Seed archive | `deepagent/datasets/deepagent_v1_seed5_archive/` | Historical seed5 only |
223+
| Soft panel | `deepagent/datasets/panel_deepagent_5pack/` | Report JSON evidence |
224+
| CLI package | `deepagent/src/swe_factory/` | `swe-factory` entrypoint |
225225

226226
Install and use from the subproject (Python >= 3.12):
227227

228228
```bash
229-
cd swe-dataset-factory
229+
cd deepagent
230230
pip install -e ".[dev]"
231231
cp .env.example .env # never commit .env
232232

233-
# DeepSWE-grade Pier + mini-swe serial eval (product root N=20)
234-
swe-factory eval-deepswe --product-root datasets/deepswe_v1 --help
233+
# DeepAgent-grade Pier + mini-swe serial eval (product root N=20)
234+
swe-factory eval-deepagent --product-root datasets/deepagent_v1 --help
235235
```
236236

237237
Details, ship commands, and honesty boundaries live in
238-
[`swe-dataset-factory/README.md`](swe-dataset-factory/README.md).
238+
[`deepagent/README.md`](deepagent/README.md).
239239
Forge mining (`swe-forge` under `src/`) remains the existing Agent-SWE path;
240240
the factory is a clean subproject so it does not clash with `src/swe_forge`.
241241

Lines changed: 59 additions & 59 deletions
Original file line numberDiff line numberDiff line change
@@ -2,9 +2,9 @@
22

33
# SWE Dataset Factory
44

5-
**Manufacture hard, Docker-verifiable SWE tasks as DeepSWE / Harbor pack trees.**
5+
**Manufacture hard, Docker-verifiable SWE tasks as DeepAgent / Harbor pack trees.**
66

7-
<a href="#ship-deepswe-v1">Ship DeepSWE</a> ·
7+
<a href="#ship-deepagent-v1">Ship DeepAgent</a> ·
88
<a href="#cli-swe-factory">CLI</a> ·
99
<a href="docs/architecture.md">Architecture</a> ·
1010
<a href="#historical-fixtures-non-product">Fixtures</a>
@@ -18,13 +18,13 @@
1818

1919
## Overview
2020

21-
SWE Dataset Factory builds **agent-facing Harbor / DeepSWE pack trees** from
21+
SWE Dataset Factory builds **agent-facing Harbor / DeepAgent pack trees** from
2222
multi-file hard tasks. Each certified pack carries a real public repository URL,
2323
an immutable base commit, multi-file gold solution, held-out verifier tests,
2424
Docker oracle dual-truth (solution reward = 1, null reward = 0), agent
2525
isolation, and optional hardness-panel evidence.
2626

27-
**Product surface:** `datasets/deepswe_v1` — **N=20** certified packs,
27+
**Product surface:** `datasets/deepagent_v1` — **N=20** certified packs,
2828
`source_track=real_pr`, **live-mined** (not a fixture shortlist),
2929
`materials_is_fixture=false`. Docker oracle only via `HarborDockerVerifier`
3030
(solution reward = 1, null reward = 0); fake backends refused on the certified
@@ -39,8 +39,8 @@ ledger spend is project OpenRouter settle only — do not invent panel spend.
3939

4040
| Path | Role |
4141
|---|---|
42-
| `datasets/deepswe_v1_hybrid_archive/` | Sealed hybrid_curated motors (N≈113) |
43-
| `datasets/deepswe_v1_seed5_archive/` | Prior real_pr seed product (seed5) |
42+
| `datasets/deepagent_v1_hybrid_archive/` | Sealed hybrid_curated motors (N≈113) |
43+
| `datasets/deepagent_v1_seed5_archive/` | Prior real_pr seed product (seed5) |
4444

4545
`fixtures/real_pr_ship` is **unit-only** (CI / offline shortlist). It is **not**
4646
the product mine and must never pad product N. Historical regression surfaces
@@ -56,16 +56,16 @@ flowchart LR
5656
Label --> Oracle[Docker oracle sol=1 null=0]
5757
Oracle --> Export[Harbor pack export]
5858
Export --> Pier[Pier cert]
59-
Pier --> Ship[datasets/deepswe_v1]
59+
Pier --> Ship[datasets/deepagent_v1]
6060
Ship --> Prov[PROVENANCE + report + ledger]
6161
```
6262

6363
Git is the authority for commits and patches. Optional GitHub page HTTP can go
6464
through Oxylabs (`source=universal` only) when credentials are configured.
6565

66-
## What you get in a DeepSWE pack
66+
## What you get in a DeepAgent pack
6767

68-
Each pack under `datasets/deepswe_v1/tasks/<task_id>/`:
68+
Each pack under `datasets/deepagent_v1/tasks/<task_id>/`:
6969

7070
```text
7171
task.toml # schema 1.1, repository_url, base_commit_hash
@@ -97,39 +97,39 @@ Corpus-level ship artifacts:
9797
## Hybrid archive (before real-PR product overwrite)
9898

9999
Archive the sealed hybrid motor corpus **before** any real-PR promote writes
100-
into `datasets/deepswe_v1`:
100+
into `datasets/deepagent_v1`:
101101

102102
```bash
103103
# Idempotent: copy hybrid packs → archive (does not delete product here)
104-
swe-factory archive-hybrid-deepswe \
105-
--source datasets/deepswe_v1 \
106-
--archive datasets/deepswe_v1_hybrid_archive \
104+
swe-factory archive-hybrid-deepagent \
105+
--source datasets/deepagent_v1 \
106+
--archive datasets/deepagent_v1_hybrid_archive \
107107
--json
108108
```
109109

110110
| Path | Role |
111111
|---|---|
112-
| `datasets/deepswe_v1_hybrid_archive/` | Sealed hybrid_curated motors (**historical only**) |
113-
| `datasets/deepswe_v1_seed5_archive/` | Prior real_pr seed (**historical only**) |
114-
| `datasets/deepswe_v1/` | **Product** — live-mined real_pr (N=20) |
112+
| `datasets/deepagent_v1_hybrid_archive/` | Sealed hybrid_curated motors (**historical only**) |
113+
| `datasets/deepagent_v1_seed5_archive/` | Prior real_pr seed (**historical only**) |
114+
| `datasets/deepagent_v1/` | **Product** — live-mined real_pr (N=20) |
115115
| `fixtures/real_pr_ship` | Unit shortlist only (not product mine) |
116116
| `datasets/harbor_v1`, `datasets/v1` | Fixtures only (non-product) |
117117

118118
Evidence after a successful archive:
119119

120-
- `datasets/deepswe_v1_hybrid_archive/pack_manifest.json`
121-
- `datasets/deepswe_v1_hybrid_archive/tasks/<pack_id>/`
122-
- `datasets/deepswe_v1_hybrid_archive/ARCHIVE_README.md`
123-
- `datasets/deepswe_v1_hybrid_archive/archive_report.json`
120+
- `datasets/deepagent_v1_hybrid_archive/pack_manifest.json`
121+
- `datasets/deepagent_v1_hybrid_archive/tasks/<pack_id>/`
122+
- `datasets/deepagent_v1_hybrid_archive/ARCHIVE_README.md`
123+
- `datasets/deepagent_v1_hybrid_archive/archive_report.json`
124124

125-
Re-running `archive-hybrid-deepswe` is safe (idempotent no-op when the archive
125+
Re-running `archive-hybrid-deepagent` is safe (idempotent no-op when the archive
126126
already holds pack_manifest + tasks). Product clear/overwrite happens only in
127127
the real-PR ship step **after** archive verification. Hybrid is never claimed
128128
as the current certified product corpus.
129129

130-
## DeepSWE v1 product (live-mined real_pr)
130+
## DeepAgent v1 product (live-mined real_pr)
131131

132-
**Current product:** `datasets/deepswe_v1` ships **N=20** certified Real-PR
132+
**Current product:** `datasets/deepagent_v1` ships **N=20** certified Real-PR
133133
packs (`source_track=real_pr`, live-mined materials, `materials_is_fixture=false`,
134134
clone@SHA agent trees, real-suite dual-run, `HarborDockerVerifier` sol=1 / null=0).
135135

@@ -145,39 +145,39 @@ Hard floors: ≥10 source hunks, multi-file gold from a merged public PR, held-o
145145
current corpus is **scripted**; panel is offline (no invented panel spend).
146146

147147
Archives (not product N): hybrid motors under
148-
`datasets/deepswe_v1_hybrid_archive/`; prior seed under
149-
`datasets/deepswe_v1_seed5_archive/`. See archive `PROVENANCE.md` / `report.md`.
148+
`datasets/deepagent_v1_hybrid_archive/`; prior seed under
149+
`datasets/deepagent_v1_seed5_archive/`. See archive `PROVENANCE.md` / `report.md`.
150150

151151
## Historical fixtures (non-product)
152152

153153
| Surface | Path | Status |
154154
|---|---|---|
155-
| Hybrid DeepSWE motors | `datasets/deepswe_v1_hybrid_archive` | **Historical hybrid archive only** |
156-
| Seed5 real_pr product | `datasets/deepswe_v1_seed5_archive` | **Historical real_pr seed only** |
155+
| Hybrid DeepAgent motors | `datasets/deepagent_v1_hybrid_archive` | **Historical hybrid archive only** |
156+
| Seed5 real_pr product | `datasets/deepagent_v1_seed5_archive` | **Historical real_pr seed only** |
157157
| Real-PR unit shortlist | `fixtures/real_pr_ship` | **Unit / CI only — not product mine** |
158158
| Harbor motors (synth) | `datasets/harbor_v1` | **Historical fixture / regression only** |
159159
| V1 boltons JSONL | `datasets/v1` | **Historical fixture / regression only** |
160-
| DeepSWE product | `datasets/deepswe_v1` | **Product north star (live-mined real_pr, N=20)** |
160+
| DeepAgent product | `datasets/deepagent_v1` | **Product north star (live-mined real_pr, N=20)** |
161161

162-
- `datasets/deepswe_v1_hybrid_archive`: archived hybrid_curated motors.
162+
- `datasets/deepagent_v1_hybrid_archive`: archived hybrid_curated motors.
163163
**Not** the Real-PR product; do not count archive N as product N.
164-
- `datasets/deepswe_v1_seed5_archive`: prior real_pr seed product archived
164+
- `datasets/deepagent_v1_seed5_archive`: prior real_pr seed product archived
165165
before live-mine overwrite. **Not** current product N.
166166
- `fixtures/real_pr_ship`: offline unit shortlist for tests. **Never** pad
167167
product N; product materials are live-mined (not fixture).
168168
- `datasets/harbor_v1`: twelve multi-language synthetic motors; may still use a
169-
non-Docker offline oracle for fixture demos. **Not** DeepSWE Real-PR product.
169+
non-Docker offline oracle for fixture demos. **Not** DeepAgent Real-PR product.
170170
- `datasets/v1`: twenty multi-file boltons synthetic keeps for older V1 export
171-
path tests. **Not** DeepSWE Real-PR product.
171+
path tests. **Not** DeepAgent Real-PR product.
172172
- Milestone and product count gates use **only** independent
173-
`datasets/deepswe_v1` certified live-mined `real_pr` N.
173+
`datasets/deepagent_v1` certified live-mined `real_pr` N.
174174

175-
## Ship DeepSWE v1
175+
## Ship DeepAgent v1
176176

177177
### Setup
178178

179179
```bash
180-
cd /projects/swe-dataset-factory
180+
cd /projects/deepagent
181181
python3 -m venv .venv
182182
.venv/bin/pip install -U pip
183183
.venv/bin/pip install -e ".[dev]"
@@ -204,11 +204,11 @@ secrets are fail-closed on the certified path.
204204
### Archive legacy product first (before live-mine overwrite)
205205

206206
```bash
207-
swe-factory archive-hybrid-deepswe --json
208-
# → datasets/deepswe_v1_hybrid_archive/
207+
swe-factory archive-hybrid-deepagent --json
208+
# → datasets/deepagent_v1_hybrid_archive/
209209

210-
swe-factory archive-seed5-deepswe --json
211-
# → datasets/deepswe_v1_seed5_archive/ (prior real_pr seed; not live N)
210+
swe-factory archive-seed5-deepagent --json
211+
# → datasets/deepagent_v1_seed5_archive/ (prior real_pr seed; not live N)
212212
```
213213

214214
### Live-mine product packs (Real-PR M14)
@@ -221,13 +221,13 @@ GitHub auth first (`gh auth login` or set `GITHUB_TOKEN` / `GH_TOKEN`):
221221
swe-factory real-pr-pool --live --out datasets/real_pr_pool_live --json
222222

223223
# 2) Ship product with --live-mine (refuses fixture pad of productN)
224-
swe-factory ship-deepswe --out datasets/deepswe_v1 \
224+
swe-factory ship-deepagent --out datasets/deepagent_v1 \
225225
--source real_pr --live-mine --target 20 --min-packs 15 \
226226
--oracle docker --panel offline --pier scripted --json
227227

228228
# Fake oracle and hybrid bind are hard-refused on the product path (non-zero)
229-
swe-factory ship-deepswe --oracle fake # exit 2
230-
swe-factory ship-deepswe --source real_pr --hybrid-bind # exit 2
229+
swe-factory ship-deepagent --oracle fake # exit 2
230+
swe-factory ship-deepagent --source real_pr --hybrid-bind # exit 2
231231
```
232232

233233
On memory-constrained hosts, Docker oracle cert may need **serial** runs
@@ -237,9 +237,9 @@ Product truth (current wave):
237237

238238
| Path | Role |
239239
|---|---|
240-
| `datasets/deepswe_v1/` | **Product** — live-mined `source_track=real_pr`, **N=20** |
241-
| `datasets/deepswe_v1_hybrid_archive/` | Historical hybrid motors (never product N) |
242-
| `datasets/deepswe_v1_seed5_archive/` | Historical real_pr seed (never live N) |
240+
| `datasets/deepagent_v1/` | **Product** — live-mined `source_track=real_pr`, **N=20** |
241+
| `datasets/deepagent_v1_hybrid_archive/` | Historical hybrid motors (never product N) |
242+
| `datasets/deepagent_v1_seed5_archive/` | Historical real_pr seed (never live N) |
243243
| `fixtures/real_pr_ship` | Unit shortlist only (not product mine) |
244244
| `datasets/harbor_v1`, `datasets/v1` | Non-product fixtures |
245245

@@ -255,13 +255,13 @@ evidence (scripted on this ship). `PROVENANCE.md` / `report.md` count
255255
swe-factory --help
256256
swe-factory config # masked settings
257257
swe-factory ledger # exact spend vs $600
258-
swe-factory archive-hybrid-deepswe --help
259-
swe-factory archive-seed5-deepswe --help
258+
swe-factory archive-hybrid-deepagent --help
259+
swe-factory archive-seed5-deepagent --help
260260
swe-factory real-pr-pool --help
261-
swe-factory ship-deepswe --help
261+
swe-factory ship-deepagent --help
262262
swe-factory discover --help
263263
swe-factory mine-allowlist --help
264-
swe-factory deepswe-oracle --help
264+
swe-factory deepagent-oracle --help
265265
swe-factory pier-cert --help
266266
swe-factory oxylabs-probe --json --out datasets/oxylabs_probe_val_oxy_005.json
267267
```
@@ -302,7 +302,7 @@ Unit and package checks:
302302
Focused shipping suites:
303303

304304
```bash
305-
.venv/bin/python -m pytest tests/test_ship_deepswe.py -q -p no:cacheprovider
305+
.venv/bin/python -m pytest tests/test_ship_deepagent.py -q -p no:cacheprovider
306306
.venv/bin/python -m pytest tests/test_package_layout.py -q -p no:cacheprovider
307307
```
308308

@@ -315,32 +315,32 @@ Focused shipping suites:
315315
4. **Oracle-cert** with Docker: solution reward 1, null reward 0; refuse fake.
316316
5. **Export** Harbor v1.1 tree with held-out tests and isolation-clean agent view.
317317
6. **Pier-load** proof and optional hardness panel while budget remains.
318-
7. **Ship** to `datasets/deepswe_v1` with PROVENANCE, report, and ledger.
318+
7. **Ship** to `datasets/deepagent_v1` with PROVENANCE, report, and ledger.
319319

320320
## Documentation
321321

322322
| Audience | Guide | Contents |
323323
|---|---|---|
324324
| New operators | this README | setup, ship, fixture labeling |
325325
| Implementers | [docs/architecture.md](docs/architecture.md) | pipeline stages and gates |
326-
| Consumers of packs | `datasets/deepswe_v1/report.md` | corpus mix and honesty notes |
327-
| License audit | `datasets/deepswe_v1/PROVENANCE.md` | license / URL / SHA per keep |
326+
| Consumers of packs | `datasets/deepagent_v1/report.md` | corpus mix and honesty notes |
327+
| License audit | `datasets/deepagent_v1/PROVENANCE.md` | license / URL / SHA per keep |
328328

329329
## Repository layout
330330

331331
```text
332332
src/swe_factory/
333333
cli.py # swe-factory entrypoint
334-
pipeline/ship_deepswe.py
334+
pipeline/ship_deepagent.py
335335
harbor/ # pack export + docker oracle cert
336336
producers/ # mine / motors / labeling
337337
sources/ # allowlist, git mine, oxylabs client
338338
accounting.py # exact ledger under $600 cap
339339
fixtures/ # offline regression trees
340340
datasets/
341-
deepswe_v1/ # PRODUCT: live-mined real_pr N=20
342-
deepswe_v1_hybrid_archive/ # historical hybrid motors
343-
deepswe_v1_seed5_archive/ # historical real_pr seed
341+
deepagent_v1/ # PRODUCT: live-mined real_pr N=20
342+
deepagent_v1_hybrid_archive/ # historical hybrid motors
343+
deepagent_v1_seed5_archive/ # historical real_pr seed
344344
harbor_v1/ # historical Harbor motors fixture
345345
v1/ # historical boltons V1 export
346346
fixtures/
@@ -352,7 +352,7 @@ docs/
352352

353353
## Limits and non-goals
354354

355-
- Product count is **`datasets/deepswe_v1` only** (live-mined real_pr). Hybrid
355+
- Product count is **`datasets/deepagent_v1` only** (live-mined real_pr). Hybrid
356356
archive, seed5 archive, `fixtures/real_pr_ship`, Harbor motors, and boltons
357357
never substitute for product N.
358358
- Current language mix: python 17, javascript 2, rust 1. Under-supply must be
@@ -374,7 +374,7 @@ docs/
374374
| Under cap | yes |
375375
| This wave panel provider calls | 0 (panel offline) |
376376

377-
Source of truth: `swe-factory ledger` and `datasets/deepswe_v1/ledger_summary.json`.
377+
Source of truth: `swe-factory ledger` and `datasets/deepagent_v1/ledger_summary.json`.
378378

379379
## License
380380

Lines changed: 9 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,9 @@
1+
# datasets/deepagent_v1 — Real-PR product (live mine)
2+
3+
This directory ships **source_track=real_pr** Harbor packs only.
4+
Hybrid motor corpus: `datasets/deepagent_v1_hybrid_archive/`.
5+
Prior seed product: `datasets/deepagent_v1_seed5_archive/`.
6+
Certified N this wave: **17** (target=20, min≥15).
7+
Materials: /projects/deepagent/datasets/live_materials_min15boost (live_mine=True; never fixtures/real_pr_ship for product).
8+
Docker oracle: HarborDockerVerifier sol=1 / null=0; pier mode honest;
9+
gate_audit dual-truth pass required before overwrite (VAL-LSHIP-007).

swe-dataset-factory/datasets/deepswe_v1/PROVENANCE.md renamed to deepagent/datasets/deepagent_v1/PROVENANCE.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
1-
# PROVENANCE — datasets/deepswe_v1 (Real-PR product)
1+
# PROVENANCE — datasets/deepagent_v1 (Real-PR product)
22

33
Corpus of Docker-oracle-certified **real_pr** Harbor packs only.
4-
Hybrid motors live under `datasets/deepswe_v1_hybrid_archive/` (historical; never counted here as product N).
4+
Hybrid motors live under `datasets/deepagent_v1_hybrid_archive/` (historical; never counted here as product N).
55
Each row is one certified keep. Copyleft / unknown-license candidates
66
are fail-closed and never appear here.
77

@@ -30,8 +30,8 @@ are fail-closed and never appear here.
3030

3131
## Notes
3232

33-
- Product surface: `datasets/deepswe_v1` (source_track=real_pr only).
34-
- Hybrid archive (historical only): `datasets/deepswe_v1_hybrid_archive/`.
33+
- Product surface: `datasets/deepagent_v1` (source_track=real_pr only).
34+
- Hybrid archive (historical only): `datasets/deepagent_v1_hybrid_archive/`.
3535
- Fixtures (non-product): `datasets/harbor_v1`, `datasets/v1`.
3636
- Agent trees clone public git @ base SHA (no motor COPY hybrid_bind).
3737
- Docker oracle dual truth: sol=1 / null=0 (never `oracle_mode=fake`).

0 commit comments

Comments
 (0)