我用scrapy爬蟲的時候遇到了下面的問題，請問有人知道是什么原因要怎么解決嗎？（我之前是可以爬取的突然就成這樣了，而且我能進去網站）
C:\Users\Administrator\AppData\Local\Programs\Python\Python37\python.exe D:/DaiMa/dfcf/dfcf/start.py
2020-06-07 12:50:47 [scrapy.utils.log] INFO: Scrapy 1.7.3 started (bot: dfcf)
2020-06-07 12:50:47 [scrapy.utils.log] INFO: Versions: lxml 4.4.1.0, libxml2 2.9.5, cssselect 1.1.0, parsel 1.5.2, w3lib 1.21.0, Twisted 19.7.0, Python 3.7.2 (tags/v3.7.2:9a3ffc0492, Dec 23 2018, 23:09:28) [MSC v.1916 64 bit (AMD64)], pyOpenSSL 19.0.0 (OpenSSL 1.1.1c 28 May 2019), cryptography 2.7, Platform Windows-7-6.1.7601-SP1
2020-06-07 12:50:47 [scrapy.crawler] INFO: Overridden settings: {'BOT_NAME': 'dfcf', 'DOWNLOAD_DELAY': 1.5, 'NEWSPIDER_MODULE': 'dfcf.spiders', 'SPIDER_MODULES': ['dfcf.spiders']}
2020-06-07 12:50:48 [scrapy.extensions.telnet] INFO: Telnet Password: 63a869a4bbe34455
2020-06-07 12:50:48 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.logstats.LogStats']
2020-06-07 12:50:50 [scrapy.middleware] INFO: Enabled downloader middlewares:
['dfcf.middlewares.UserAgentDownloadMiddleware',
'dfcf.middlewares.IPProxyDownloadMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2020-06-07 12:50:50 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'scrapy.spi
轉載請註明出處，本文鏈接：https://www.uj5u.com/qita/44878.html
標籤：其他技術討論專區