Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

fetcher makes a lot of queries #28

Open
philbudne opened this issue Oct 23, 2023 · 0 comments
Open

fetcher makes a lot of queries #28

philbudne opened this issue Oct 23, 2023 · 0 comments
Labels
enhancement New feature or request prio-low

Comments

@philbudne
Copy link
Contributor

philbudne commented Oct 23, 2023

The fetcher queries the feeds table for worker once a minute (headhunter.DB_READY_SEC)

One reason is so that "fetch soon" requests are noticed in a timely manner.

There are some efficiency improvement ideas at the top of fetcher/hunter.py and fetcher/scoreboard.py

@rahulbot rahulbot added enhancement New feature or request prio-low labels Feb 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request prio-low
Projects
None yet
Development

No branches or pull requests

2 participants