我有一個報廢專案要做，但我的請求有問題。目標是收集有關 NFL 球員的資訊，但由于我的請求涉及多個網頁，我無法連接我的資訊。這是我的代碼：
import requests
import re
import pdb
import pickle
request_headers={'User-Agent': "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:97.0) Gecko/20100101 Firefox/97.0" }
url='https://www.spotrac.com/nfl/valuation/2021'
complement=['/quarterback/','/kicker/']
for c in complement:
req=requests.get(url c,headers=request_headers,timeout=10)
content=req.text
pattern = 'a href="https://www.spotrac.com/redirect/player/(. ?(?=/">))'
output=re.findall(pattern,content)
with open('Identifiant','ab') as my_file:
pickle.dump(output,my_file)
for identifiant in output:
urlfiche = "https://www.spotrac.com/redirect/player/" identifiant
req = requests.get(urlfiche,headers=request_headers)
content = req.text
pdb.set_trace()
我的問題如下：當我運行命令時
print(output)
當我想保留所有這些（如在我的“ID”物件中）時，我只獲得最后一個串列（踢球者）的玩家 ID 我嘗試在輸出上創建一個空串列并使用 append 函式，但不可能將字串與串列連接起來。
有沒有人有辦法解決嗎？
對不起我的英語，我是法國人:)
uj5u.com熱心網友回復：
要獲得所有 id 的一個串列，只需在 for 回圈上方擴展您的空串列，每次迭代都會刮掉資訊：
data.extend(re.findall(pattern,content))
例子
import requests
import re
request_headers={'User-Agent': "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:97.0) Gecko/20100101 Firefox/97.0" }
url='https://www.spotrac.com/nfl/valuation/2021'
complement=['/quarterback/','/running-back/','/wide-receiver/','/tight-end/','/left-tackle/','/right-tackle/','/center/','/guard/','/defensive-tackle/','/defensive-end/','/outside-linebacker/','/inside-linebacker/','/cornerback/','/free-safety/','/strong-safety/','/kicker/']
data = []
for c in complement:
req=requests.get(url c,headers=request_headers,timeout=10)
content=req.text
pattern = 'a href="https://www.spotrac.com/redirect/player/(. ?(?=/">))'
data.extend(re.findall(pattern,content))
print(data)
輸出
['47599', '47594', '47648', '29036', '4619', '25127', '3745', '25102', '9915', '6078', '72395', '14441', '29041', '19089', '9818', '21751', '47598', '14445', '17249', '14472', '9885', '25096', '72447', '72391', '3983', '18950', '25098', '72380', '72381', '3595', '18949', '47636', '29123', '21847', '72578', '47657', '22247', '12309', '21745', '29059', '72404', '29109', '72415', '21789', '29106', '25134', '48079', '72491', '47661', '21924', '16739', '29089', '25235', '29110', '25573', '14514', '47630', '29282', '25126', '72510', '7743', '19090', '12472', '21782', '18952', '21809', '29234', '25097', '16852',...]
轉載請註明出處，本文鏈接：https://www.uj5u.com/ruanti/430297.html
標籤：Python python-3.x 列表 网页抓取
上一篇：如何將串列資料插入SQLite？