Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to use the scheduling parameters to only run scraper for only 1 time ? #94

Open
vaimdev opened this issue Jul 15, 2017 · 1 comment

Comments

@vaimdev
Copy link

vaimdev commented Jul 15, 2017

I have tried to read the Documentation and still cannot understand how can I adjust the parameters to only run the scraper for only 1 time.

I have a scraper just to scrape google search result with fix keyword. I only need to run it for 1 time but I need to schedule it.

I come across this in the documentation :
If you don’t need dynamic scheduling, you can also just set the MIN_TIME and the MAX_TIME to the same values and just ignore the rest.

Does it mean if I set MIN_TIME = MAX_TIME , then it will only run 1 time ?

"MIN_TIME": 1440,
"MAX_TIME": 10080,
"INITIAL_NEXT_ACTION_FACTOR": 1,
"ZERO_ACTIONS_FACTOR_CHANGE": 5,
"FACTOR_CHANGE_FACTOR": 1.3

@bezkos
Copy link

bezkos commented Jul 16, 2017

If u set MIN=MAX then it means that your spider ll run every a fixed amount of time ex 15 min and it disables dynamic scheduling.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants