我是一名涉足網路抓取的社會科學家。我一直試圖從這個頁面抓取鏈接 每日新聞的鏈接排列在一個表格結構中。這是我的代碼
options = Options()
options.add_argument("--disable-notifications")
driver = webdriver.Chrome(driverLocation,chrome_options=options)
browser = webdriver.Chrome()
url='https://economictimes.indiatimes.com//archive/year-2021,month-1.cms'
browser.get(url)
table = browser.find_element(By.ID,"calender");
rows=table.find_element(By.TAG_NAME, "tr")
td=rows.find_element(By.TAG_NAME, "td")
print(td.get_attribute('href'))
該get_attribute回報沒有。我已經嘗試了很多-by的Xpath等其他組合的,但它不是為我作業。有人可以幫我解決這個問題嗎?
uj5u.com熱心網友回復:
如果您打算抓取 td a 標簽下的所有鏈接,您可以嘗試以下解決方案。
代碼 :
browser.maximize_window()
wait = WebDriverWait(browser, 30)
browser.get("https://economictimes.indiatimes.com/archive/year-2021,month-1.cms")
hrefs = wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR, "table#calender td a")))
for href in hrefs:
print(href.get_attribute('href'))
進口:
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC
輸出 :
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44197.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44197.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44197.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44197.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44197.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44197.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44198.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44199.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44200.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44201.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44202.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44203.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44204.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44205.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44206.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44207.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44208.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44209.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44210.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44211.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44212.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44213.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44214.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44215.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44216.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44217.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44218.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44219.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44220.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44221.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44222.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44223.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44224.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44225.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44226.cms
https://economictimes.indiatimes.com/archivelist/year-2021,month-1,starttime-44227.cms
轉載請註明出處,本文鏈接:https://www.uj5u.com/ruanti/362044.html
上一篇:嘗試從網站中提取多個資料
下一篇:我怎樣才能實作這個IF條件?
