scrapy 框架下爬取資料,資料爬取成功,再settings 添加,讓爬取的資料保存在本地csv格式,每次運行只是生成一個表頭,不在繼續寫入其他資料,而如果改為excel模式,卻可以正常的寫入檔案。
#settings設定如下:
BOT_NAME = 'dangdang'
SPIDER_MODULES = ['dangdang.spiders']
NEWSPIDER_MODULE = 'dangdang.spiders'
# Crawl responsibly by identifying yourself (and your website) on the user-agent
USER_AGENT = 'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/63.0.3239.132 Safari/537.36'
# Obey robots.txt rules
ROBOTSTXT_OBEY = False
FEED_URI='作業dangdang.csv'
FEED_FORMAT='CSV'
FEED_EXPORT_ENCODING='ansi'
DOWNLOAD_DELAY = 0.5
ITEM_PIPELINES = {
'dangdang.pipelines.DangdangPipeline': 300,
}
uj5u.com熱心網友回復:


轉載請註明出處,本文鏈接:https://www.uj5u.com/qita/110810.html
上一篇:各位大神幫幫忙!!
