Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

WIP: add BanAwareCachePolicy for http caching #26

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

Granitosaurus
Copy link

Add policy for scrapy's http caching that will refuse caching of banned responses as per #20

@Granitosaurus Granitosaurus changed the title add BanAwareCachePolicy for http caching WIP: add BanAwareCachePolicy for http caching May 15, 2019
@Granitosaurus
Copy link
Author

I'm not sure how should we cover multiple policies? Should we just wrap the two default policies that scrapy has (RFC2616Policy and DummyPolicy) or maybe we should extend HttpCacheMiddleware this way all policies would be supported?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant