Commit 0765b60
[SCR-383] Auto-Mode (--mode auto / --max-cost) support
Add Auto-Mode to the `scrape` command, mirroring the server-side beta feature.
The API picks the cheapest scraping config that succeeds (cheap -> expensive,
stops at first success) and charges only for the winning config.
- scrape.py: `--mode` (Choice[auto]) + `--max-cost` (int) options; signature;
pass-through to build_scrape_kwargs; validation guards (mode-auto vs
render_js/premium_proxy/stealth_proxy/transparent_status_code incompatibility,
max_cost requires mode=auto, max_cost >= 1 via _validate_range).
- cli_utils.py: build_scrape_kwargs mode/max_cost; surface Spb-auto-cost header
("Auto Credit Cost") in write_output verbose block.
- client.py: Client.scrape() mode/max_cost params (omitted when None).
- Tests: TestModeParam + TestMaxCostParam (test_client.py) and
TestModeAutoGuards command-level guard tests (test_cli.py).
- Docs: SKILL.md reference/scrape/options.md (Auto-Mode section), README,
CHANGELOG [1.4.5]; synced via sync-skills.sh.
- Version bumped 1.4.4 -> 1.4.5 across all version-bearing files.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>1 parent bdcc324 commit 0765b60
26 files changed
Lines changed: 267 additions & 15 deletions
File tree
- .agents/skills
- scrapingbee-cli-guard
- scrapingbee-cli
- reference/scrape
- .github/skills
- scrapingbee-cli-guard
- scrapingbee-cli
- reference/scrape
- .kiro/skills
- scrapingbee-cli-guard
- scrapingbee-cli
- reference/scrape
- .opencode/skills
- scrapingbee-cli-guard
- scrapingbee-cli
- reference/scrape
- plugins/scrapingbee-cli
- .claude-plugin
- skills
- scrapingbee-cli-guard
- scrapingbee-cli
- reference/scrape
- src/scrapingbee_cli
- commands
- tests/unit
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
Lines changed: 16 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
| 76 | + | |
| 77 | + | |
76 | 78 | | |
77 | 79 | | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
78 | 94 | | |
79 | 95 | | |
80 | 96 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
Lines changed: 16 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
| 76 | + | |
| 77 | + | |
76 | 78 | | |
77 | 79 | | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
78 | 94 | | |
79 | 95 | | |
80 | 96 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
73 | 73 | | |
74 | 74 | | |
75 | 75 | | |
| 76 | + | |
| 77 | + | |
76 | 78 | | |
77 | 79 | | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
78 | 94 | | |
79 | 95 | | |
80 | 96 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
| 3 | + | |
4 | 4 | | |
5 | 5 | | |
6 | 6 | | |
| |||
0 commit comments