Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

请问最后爬不到数据是什么原因呢 #10

Open
dg5566 opened this issue Jul 18, 2020 · 1 comment
Open

请问最后爬不到数据是什么原因呢 #10

dg5566 opened this issue Jul 18, 2020 · 1 comment

Comments

@dg5566
Copy link

dg5566 commented Jul 18, 2020

2020-07-18 19:03:56 [scrapy.middleware] INFO: Enabled item pipelines:
['sina.pipelines.MongoDBPipeline']
2020-07-18 19:03:56 [scrapy.core.engine] INFO: Spider opened
2020-07-18 19:03:56 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2020-07-18 19:03:56 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2020-07-18 19:03:56 [py.warnings] WARNING: D:\study\Python3.7\lib\site-packages\scrapy\spiders_init_.py:81: UserWarning: Spider.make_requests_from_url method is deprecated: it will be removed and not be called by the default Spider.start_requests method in future Scrapy releases. Please override Spider.start_requests method instead.
warnings.warn(

@seaweiqing
Copy link
Member

抓数据之前先自己上.cn按照设定的条件检索,看是否真的存在数据,才能进行下一步。你设定的条件返回的url就可以做验证。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants