Skip to content
This repository has been archived by the owner on Jun 30, 2021. It is now read-only.

non-id based crawling #12

Open
madprogramer opened this issue Dec 15, 2020 · 1 comment
Open

non-id based crawling #12

madprogramer opened this issue Dec 15, 2020 · 1 comment
Labels
enhancement New feature or request help wanted Extra attention is needed
Milestone
Beta

Comments

@madprogramer
Copy link
Member

Scrapy is particularly good because their crawlers can be distributed etc.
@madprogramer madprogramer changed the title Alternative Crawling Methods with Scrapy non-id based crawling Dec 30, 2020
@madprogramer
Copy link
Member Author

madprogramer commented Dec 30, 2020 •
edited
Loading

Save links to file, [CONFIGNAME]-links.csv or similar

@madprogramer madprogramer added the enhancement New feature or request label Dec 30, 2020
@madprogramer madprogramer added this to the Beta milestone Dec 30, 2020
@madprogramer madprogramer added the help wanted Extra attention is needed label Dec 30, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees
No one assigned
Labels
enhancement New feature or request help wanted Extra attention is needed
Projects
None yet
Milestone
Beta
Development

No branches or pull requests
1 participant
@madprogramer