22
33# SWE Dataset Factory
44
5- ** Manufacture hard, Docker-verifiable SWE tasks as DeepSWE / Harbor pack trees.**
5+ ** Manufacture hard, Docker-verifiable SWE tasks as DeepAgent / Harbor pack trees.**
66
7- <a href =" #ship-deepswe -v1 " >Ship DeepSWE </a > ·
7+ <a href =" #ship-deepagent -v1 " >Ship DeepAgent </a > ·
88<a href =" #cli-swe-factory " >CLI</a > ·
99<a href =" docs/architecture.md " >Architecture</a > ·
1010<a href =" #historical-fixtures-non-product " >Fixtures</a >
1818
1919## Overview
2020
21- SWE Dataset Factory builds ** agent-facing Harbor / DeepSWE pack trees** from
21+ SWE Dataset Factory builds ** agent-facing Harbor / DeepAgent pack trees** from
2222multi-file hard tasks. Each certified pack carries a real public repository URL,
2323an immutable base commit, multi-file gold solution, held-out verifier tests,
2424Docker oracle dual-truth (solution reward = 1, null reward = 0), agent
2525isolation, and optional hardness-panel evidence.
2626
27- ** Product surface:** ` datasets/deepswe_v1 ` — ** N=20** certified packs,
27+ ** Product surface:** ` datasets/deepagent_v1 ` — ** N=20** certified packs,
2828` source_track=real_pr ` , ** live-mined** (not a fixture shortlist),
2929` materials_is_fixture=false ` . Docker oracle only via ` HarborDockerVerifier `
3030(solution reward = 1, null reward = 0); fake backends refused on the certified
@@ -39,8 +39,8 @@ ledger spend is project OpenRouter settle only — do not invent panel spend.
3939
4040| Path | Role |
4141| ---| ---|
42- | ` datasets/deepswe_v1_hybrid_archive / ` | Sealed hybrid_curated motors (N≈113) |
43- | ` datasets/deepswe_v1_seed5_archive / ` | Prior real_pr seed product (seed5) |
42+ | ` datasets/deepagent_v1_hybrid_archive / ` | Sealed hybrid_curated motors (N≈113) |
43+ | ` datasets/deepagent_v1_seed5_archive / ` | Prior real_pr seed product (seed5) |
4444
4545` fixtures/real_pr_ship ` is ** unit-only** (CI / offline shortlist). It is ** not**
4646the product mine and must never pad product N. Historical regression surfaces
@@ -56,16 +56,16 @@ flowchart LR
5656 Label --> Oracle[Docker oracle sol=1 null=0]
5757 Oracle --> Export[Harbor pack export]
5858 Export --> Pier[Pier cert]
59- Pier --> Ship[datasets/deepswe_v1 ]
59+ Pier --> Ship[datasets/deepagent_v1 ]
6060 Ship --> Prov[PROVENANCE + report + ledger]
6161```
6262
6363Git is the authority for commits and patches. Optional GitHub page HTTP can go
6464through Oxylabs (` source=universal ` only) when credentials are configured.
6565
66- ## What you get in a DeepSWE pack
66+ ## What you get in a DeepAgent pack
6767
68- Each pack under ` datasets/deepswe_v1 /tasks/<task_id>/ ` :
68+ Each pack under ` datasets/deepagent_v1 /tasks/<task_id>/ ` :
6969
7070``` text
7171task.toml # schema 1.1, repository_url, base_commit_hash
@@ -97,39 +97,39 @@ Corpus-level ship artifacts:
9797## Hybrid archive (before real-PR product overwrite)
9898
9999Archive the sealed hybrid motor corpus ** before** any real-PR promote writes
100- into ` datasets/deepswe_v1 ` :
100+ into ` datasets/deepagent_v1 ` :
101101
102102``` bash
103103# Idempotent: copy hybrid packs → archive (does not delete product here)
104- swe-factory archive-hybrid-deepswe \
105- --source datasets/deepswe_v1 \
106- --archive datasets/deepswe_v1_hybrid_archive \
104+ swe-factory archive-hybrid-deepagent \
105+ --source datasets/deepagent_v1 \
106+ --archive datasets/deepagent_v1_hybrid_archive \
107107 --json
108108```
109109
110110| Path | Role |
111111| ---| ---|
112- | ` datasets/deepswe_v1_hybrid_archive / ` | Sealed hybrid_curated motors (** historical only** ) |
113- | ` datasets/deepswe_v1_seed5_archive / ` | Prior real_pr seed (** historical only** ) |
114- | ` datasets/deepswe_v1 / ` | ** Product** — live-mined real_pr (N=20) |
112+ | ` datasets/deepagent_v1_hybrid_archive / ` | Sealed hybrid_curated motors (** historical only** ) |
113+ | ` datasets/deepagent_v1_seed5_archive / ` | Prior real_pr seed (** historical only** ) |
114+ | ` datasets/deepagent_v1 / ` | ** Product** — live-mined real_pr (N=20) |
115115| ` fixtures/real_pr_ship ` | Unit shortlist only (not product mine) |
116116| ` datasets/harbor_v1 ` , ` datasets/v1 ` | Fixtures only (non-product) |
117117
118118Evidence after a successful archive:
119119
120- - ` datasets/deepswe_v1_hybrid_archive /pack_manifest.json `
121- - ` datasets/deepswe_v1_hybrid_archive /tasks/<pack_id>/ `
122- - ` datasets/deepswe_v1_hybrid_archive /ARCHIVE_README.md `
123- - ` datasets/deepswe_v1_hybrid_archive /archive_report.json `
120+ - ` datasets/deepagent_v1_hybrid_archive /pack_manifest.json `
121+ - ` datasets/deepagent_v1_hybrid_archive /tasks/<pack_id>/ `
122+ - ` datasets/deepagent_v1_hybrid_archive /ARCHIVE_README.md `
123+ - ` datasets/deepagent_v1_hybrid_archive /archive_report.json `
124124
125- Re-running ` archive-hybrid-deepswe ` is safe (idempotent no-op when the archive
125+ Re-running ` archive-hybrid-deepagent ` is safe (idempotent no-op when the archive
126126already holds pack_manifest + tasks). Product clear/overwrite happens only in
127127the real-PR ship step ** after** archive verification. Hybrid is never claimed
128128as the current certified product corpus.
129129
130- ## DeepSWE v1 product (live-mined real_pr)
130+ ## DeepAgent v1 product (live-mined real_pr)
131131
132- ** Current product:** ` datasets/deepswe_v1 ` ships ** N=20** certified Real-PR
132+ ** Current product:** ` datasets/deepagent_v1 ` ships ** N=20** certified Real-PR
133133packs (` source_track=real_pr ` , live-mined materials, ` materials_is_fixture=false ` ,
134134clone@SHA agent trees, real-suite dual-run, ` HarborDockerVerifier ` sol=1 / null=0).
135135
@@ -145,39 +145,39 @@ Hard floors: ≥10 source hunks, multi-file gold from a merged public PR, held-o
145145current corpus is ** scripted** ; panel is offline (no invented panel spend).
146146
147147Archives (not product N): hybrid motors under
148- ` datasets/deepswe_v1_hybrid_archive / ` ; prior seed under
149- ` datasets/deepswe_v1_seed5_archive / ` . See archive ` PROVENANCE.md ` / ` report.md ` .
148+ ` datasets/deepagent_v1_hybrid_archive / ` ; prior seed under
149+ ` datasets/deepagent_v1_seed5_archive / ` . See archive ` PROVENANCE.md ` / ` report.md ` .
150150
151151## Historical fixtures (non-product)
152152
153153| Surface | Path | Status |
154154| ---| ---| ---|
155- | Hybrid DeepSWE motors | ` datasets/deepswe_v1_hybrid_archive ` | ** Historical hybrid archive only** |
156- | Seed5 real_pr product | ` datasets/deepswe_v1_seed5_archive ` | ** Historical real_pr seed only** |
155+ | Hybrid DeepAgent motors | ` datasets/deepagent_v1_hybrid_archive ` | ** Historical hybrid archive only** |
156+ | Seed5 real_pr product | ` datasets/deepagent_v1_seed5_archive ` | ** Historical real_pr seed only** |
157157| Real-PR unit shortlist | ` fixtures/real_pr_ship ` | ** Unit / CI only — not product mine** |
158158| Harbor motors (synth) | ` datasets/harbor_v1 ` | ** Historical fixture / regression only** |
159159| V1 boltons JSONL | ` datasets/v1 ` | ** Historical fixture / regression only** |
160- | DeepSWE product | ` datasets/deepswe_v1 ` | ** Product north star (live-mined real_pr, N=20)** |
160+ | DeepAgent product | ` datasets/deepagent_v1 ` | ** Product north star (live-mined real_pr, N=20)** |
161161
162- - ` datasets/deepswe_v1_hybrid_archive ` : archived hybrid_curated motors.
162+ - ` datasets/deepagent_v1_hybrid_archive ` : archived hybrid_curated motors.
163163 ** Not** the Real-PR product; do not count archive N as product N.
164- - ` datasets/deepswe_v1_seed5_archive ` : prior real_pr seed product archived
164+ - ` datasets/deepagent_v1_seed5_archive ` : prior real_pr seed product archived
165165 before live-mine overwrite. ** Not** current product N.
166166- ` fixtures/real_pr_ship ` : offline unit shortlist for tests. ** Never** pad
167167 product N; product materials are live-mined (not fixture).
168168- ` datasets/harbor_v1 ` : twelve multi-language synthetic motors; may still use a
169- non-Docker offline oracle for fixture demos. ** Not** DeepSWE Real-PR product.
169+ non-Docker offline oracle for fixture demos. ** Not** DeepAgent Real-PR product.
170170- ` datasets/v1 ` : twenty multi-file boltons synthetic keeps for older V1 export
171- path tests. ** Not** DeepSWE Real-PR product.
171+ path tests. ** Not** DeepAgent Real-PR product.
172172- Milestone and product count gates use ** only** independent
173- ` datasets/deepswe_v1 ` certified live-mined ` real_pr ` N.
173+ ` datasets/deepagent_v1 ` certified live-mined ` real_pr ` N.
174174
175- ## Ship DeepSWE v1
175+ ## Ship DeepAgent v1
176176
177177### Setup
178178
179179``` bash
180- cd /projects/swe-dataset-factory
180+ cd /projects/deepagent
181181python3 -m venv .venv
182182.venv/bin/pip install -U pip
183183.venv/bin/pip install -e " .[dev]"
@@ -204,11 +204,11 @@ secrets are fail-closed on the certified path.
204204### Archive legacy product first (before live-mine overwrite)
205205
206206``` bash
207- swe-factory archive-hybrid-deepswe --json
208- # → datasets/deepswe_v1_hybrid_archive /
207+ swe-factory archive-hybrid-deepagent --json
208+ # → datasets/deepagent_v1_hybrid_archive /
209209
210- swe-factory archive-seed5-deepswe --json
211- # → datasets/deepswe_v1_seed5_archive / (prior real_pr seed; not live N)
210+ swe-factory archive-seed5-deepagent --json
211+ # → datasets/deepagent_v1_seed5_archive / (prior real_pr seed; not live N)
212212```
213213
214214### Live-mine product packs (Real-PR M14)
@@ -221,13 +221,13 @@ GitHub auth first (`gh auth login` or set `GITHUB_TOKEN` / `GH_TOKEN`):
221221swe-factory real-pr-pool --live --out datasets/real_pr_pool_live --json
222222
223223# 2) Ship product with --live-mine (refuses fixture pad of productN)
224- swe-factory ship-deepswe --out datasets/deepswe_v1 \
224+ swe-factory ship-deepagent --out datasets/deepagent_v1 \
225225 --source real_pr --live-mine --target 20 --min-packs 15 \
226226 --oracle docker --panel offline --pier scripted --json
227227
228228# Fake oracle and hybrid bind are hard-refused on the product path (non-zero)
229- swe-factory ship-deepswe --oracle fake # exit 2
230- swe-factory ship-deepswe --source real_pr --hybrid-bind # exit 2
229+ swe-factory ship-deepagent --oracle fake # exit 2
230+ swe-factory ship-deepagent --source real_pr --hybrid-bind # exit 2
231231```
232232
233233On memory-constrained hosts, Docker oracle cert may need ** serial** runs
@@ -237,9 +237,9 @@ Product truth (current wave):
237237
238238| Path | Role |
239239| ---| ---|
240- | ` datasets/deepswe_v1 / ` | ** Product** — live-mined ` source_track=real_pr ` , ** N=20** |
241- | ` datasets/deepswe_v1_hybrid_archive / ` | Historical hybrid motors (never product N) |
242- | ` datasets/deepswe_v1_seed5_archive / ` | Historical real_pr seed (never live N) |
240+ | ` datasets/deepagent_v1 / ` | ** Product** — live-mined ` source_track=real_pr ` , ** N=20** |
241+ | ` datasets/deepagent_v1_hybrid_archive / ` | Historical hybrid motors (never product N) |
242+ | ` datasets/deepagent_v1_seed5_archive / ` | Historical real_pr seed (never live N) |
243243| ` fixtures/real_pr_ship ` | Unit shortlist only (not product mine) |
244244| ` datasets/harbor_v1 ` , ` datasets/v1 ` | Non-product fixtures |
245245
@@ -255,13 +255,13 @@ evidence (scripted on this ship). `PROVENANCE.md` / `report.md` count
255255swe-factory --help
256256swe-factory config # masked settings
257257swe-factory ledger # exact spend vs $600
258- swe-factory archive-hybrid-deepswe --help
259- swe-factory archive-seed5-deepswe --help
258+ swe-factory archive-hybrid-deepagent --help
259+ swe-factory archive-seed5-deepagent --help
260260swe-factory real-pr-pool --help
261- swe-factory ship-deepswe --help
261+ swe-factory ship-deepagent --help
262262swe-factory discover --help
263263swe-factory mine-allowlist --help
264- swe-factory deepswe -oracle --help
264+ swe-factory deepagent -oracle --help
265265swe-factory pier-cert --help
266266swe-factory oxylabs-probe --json --out datasets/oxylabs_probe_val_oxy_005.json
267267```
@@ -302,7 +302,7 @@ Unit and package checks:
302302Focused shipping suites:
303303
304304``` bash
305- .venv/bin/python -m pytest tests/test_ship_deepswe .py -q -p no:cacheprovider
305+ .venv/bin/python -m pytest tests/test_ship_deepagent .py -q -p no:cacheprovider
306306.venv/bin/python -m pytest tests/test_package_layout.py -q -p no:cacheprovider
307307```
308308
@@ -315,32 +315,32 @@ Focused shipping suites:
3153154 . ** Oracle-cert** with Docker: solution reward 1, null reward 0; refuse fake.
3163165 . ** Export** Harbor v1.1 tree with held-out tests and isolation-clean agent view.
3173176 . ** Pier-load** proof and optional hardness panel while budget remains.
318- 7 . ** Ship** to ` datasets/deepswe_v1 ` with PROVENANCE, report, and ledger.
318+ 7 . ** Ship** to ` datasets/deepagent_v1 ` with PROVENANCE, report, and ledger.
319319
320320## Documentation
321321
322322| Audience | Guide | Contents |
323323| ---| ---| ---|
324324| New operators | this README | setup, ship, fixture labeling |
325325| Implementers | [ docs/architecture.md] ( docs/architecture.md ) | pipeline stages and gates |
326- | Consumers of packs | ` datasets/deepswe_v1 /report.md ` | corpus mix and honesty notes |
327- | License audit | ` datasets/deepswe_v1 /PROVENANCE.md ` | license / URL / SHA per keep |
326+ | Consumers of packs | ` datasets/deepagent_v1 /report.md ` | corpus mix and honesty notes |
327+ | License audit | ` datasets/deepagent_v1 /PROVENANCE.md ` | license / URL / SHA per keep |
328328
329329## Repository layout
330330
331331``` text
332332src/swe_factory/
333333 cli.py # swe-factory entrypoint
334- pipeline/ship_deepswe .py
334+ pipeline/ship_deepagent .py
335335 harbor/ # pack export + docker oracle cert
336336 producers/ # mine / motors / labeling
337337 sources/ # allowlist, git mine, oxylabs client
338338 accounting.py # exact ledger under $600 cap
339339fixtures/ # offline regression trees
340340datasets/
341- deepswe_v1 / # PRODUCT: live-mined real_pr N=20
342- deepswe_v1_hybrid_archive / # historical hybrid motors
343- deepswe_v1_seed5_archive / # historical real_pr seed
341+ deepagent_v1 / # PRODUCT: live-mined real_pr N=20
342+ deepagent_v1_hybrid_archive / # historical hybrid motors
343+ deepagent_v1_seed5_archive / # historical real_pr seed
344344 harbor_v1/ # historical Harbor motors fixture
345345 v1/ # historical boltons V1 export
346346fixtures/
@@ -352,7 +352,7 @@ docs/
352352
353353## Limits and non-goals
354354
355- - Product count is ** ` datasets/deepswe_v1 ` only** (live-mined real_pr). Hybrid
355+ - Product count is ** ` datasets/deepagent_v1 ` only** (live-mined real_pr). Hybrid
356356 archive, seed5 archive, ` fixtures/real_pr_ship ` , Harbor motors, and boltons
357357 never substitute for product N.
358358- Current language mix: python 17, javascript 2, rust 1. Under-supply must be
@@ -374,7 +374,7 @@ docs/
374374| Under cap | yes |
375375| This wave panel provider calls | 0 (panel offline) |
376376
377- Source of truth: ` swe-factory ledger ` and ` datasets/deepswe_v1 /ledger_summary.json ` .
377+ Source of truth: ` swe-factory ledger ` and ` datasets/deepagent_v1 /ledger_summary.json ` .
378378
379379## License
380380
0 commit comments