Skip to content
This repository has been archived by the owner on Dec 28, 2023. It is now read-only.

Log target url when an exception occurs in the spider, in order to facilitate debugging #19

Open
kalessin opened this issue May 10, 2021 · 1 comment

Comments

@kalessin
Copy link

Example:

https://app.zyte.com/p/515885/7/13/log?line=173

Right now it is not possible to know which is the url that offended the spider logic.

@elacuesta
Copy link
Member

Interesting, I had seen this before but I thought it would not be a problem after scrapy/scrapy#4632, seems like I was wrong. Thanks for the report, I'll take a look into it.
In the meantime, could you try using the provided log formatter?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants