Python抓取回圈-有解無憂

所以，我需要幫助，這是我的代碼

results=[]
import re

for i in popup_linkz:  # Here I take N links like this one https://www.mercadopublico.cl/Procurement/Modules/RFB/DetailsAcquisition.aspx?qs=uEap3sWEgifS2G m9xvYiA==  to iterate thorught them a scraping

   url=i # so right now I scrape the iterating urls
  
    response = requests.get(url)
    print('url:', response.url)     
 #print('status:', response.status_code)
                
soup = BeautifulSoup(response.content, "html.parser")
results=[]
#json_res = json.loads(res.text)
#print(json_res[0]['price']) 
item_1='grvProducto_ctl02_lblCategoria'

for line in soup.findAll('span', attrs={'id': 'grvProducto_ctl02_lblCategoria'}):
    

   results.append(line.text) 
#this actually get the first code, but don't know how to iterate for others, also doesn't store every code on it, when I print doesn't stack them , show them single on print.
  
   print('id',results)

我試圖從這個 urlsample >https://www.mercadopublico.cl/Procurement/Modules/RFB/DetailsAcquisition.aspx?qs=uEap3sWEgifS2G m9xvYiA== 實際上它從 2 個迭代到 10.000 個。

我想在這里獲取資訊，但無法獲取

我不確定如何使用它

 for line in soup.findAll('span', attrs={'id': 'grvProducto_ctl02_lblCategoria'}):
        
    
       results.append(line.text)

使用相同的回圈來獲取其他資訊。底層頁面資料

你能啟發我嗎？

uj5u.com熱心網友回復：

嘗試：

import requests
from bs4 import BeautifulSoup


url = "https://www.mercadopublico.cl/Procurement/Modules/RFB/DetailsAcquisition.aspx?qs=uEap3sWEgifS2G m9xvYiA=="
soup = BeautifulSoup(requests.get(url).content, "html.parser")


licitation_number = soup.select_one("#lblNumLicitacion").text
responsable = soup.select_one("#lblResponsable").text
ficha = soup.select_one("#lblFicha2Reclamo").text

print(f"{licitation_number=}")
print(f"{responsable=}")
print(f"{ficha=}")
print("-" * 80)

for t in soup.select("#grvProducto .borde_tabla00"):
    categoria = t.select_one('[id$="lblCategoria"]').text
    candidad = t.select_one('[id$="lblCantidad"]').text
    descripction = t.select_one('[id$="lblDescripcion"]').text
    print(f"{categoria=} {candidad=}")
    print(f"{descripction=}")
    print()

印刷：

licitation_number='1549-5-LR22'
responsable='SERVICIO DE SALUD METROPOLITANA NORTE HOSPITAL SAN JOSE, Hospital San  José'
ficha='107'
--------------------------------------------------------------------------------
categoria='42221501' candidad='130'
descripction='(226-2001) STENT CORONARIO DE CROMO COBALTO, LIBERADOR DE FáRMACO EVEROLIMUS'

categoria='42221501' candidad='360'
descripction='(226-2002) STENT CORONARIO DE CROMO COBALTO, LIBERADOR DE FáRMACO ZOTAROLIMUS'

categoria='42221501' candidad='120'
descripction='(226-2004) STENT CORONARIO DE CROMO COBALTO, LIBERADOR DE FáRMACO SIROLIMUS, CON STRUT DE 0.80'

categoria='42221501' candidad='240'
descripction='(226-2003) STENT CORONARIO DE CROMO COBALTO, LIBERADOR DE FáRMACO SIROLIMUS, CON STRUT DE 0.60'

轉載請註明出處，本文鏈接：https://www.uj5u.com/yidong/450406.html

標籤：Python 循环网页抓取蜘蛛刮

上一篇：遍歷名稱串列以提取檔案并分配給Python中的字典

下一篇：PHP從陣列中寫入一個數字