Skip to content

Conversation

@yan3ku
Copy link
Contributor

@yan3ku yan3ku commented Apr 1, 2025

I added request-dont-filter to allow re-scraping the same URL
My code is using it to rescrape the same page but in slightly different way the second time depending on the request parameters.
I thought this would be usefull functionality also for others using this library.
I used the same name the scrapy python lib uses.

If this looks good to you, please merge.

@yan3ku yan3ku force-pushed the request-dont-filter branch from 3a4c1a1 to 021778b Compare April 10, 2025 09:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant