New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

SplashAwareFSCacheStorage does not handle HTTP 498 requests #296

Open

tmaier opened this issue Oct 18, 2021 · 0 comments

tmaier commented Oct 18, 2021

Hi,

I just restarted my crawler and I had HTTP 498 errors, which also in the next tries never worked.

I see the following information has been cached by SplashAwareFSCacheStorage

{"error": 498, "type": "ExpiredArguments", "description": "Arguments stored with ``save_args`` are expired", "info": {"expired": ["lua_source"]}}

It would make sense to specifically handle this case so that the next request will not lead to read this cache (or to not store it at all)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment