我試圖從站點中抓取一些資料。我正在為它使用硒,但是當我嘗試單擊站點中的元素或從站點中的元素獲取資料時,我收到 NoSuchElementException,即使該元素存在于站點中。
代碼
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
from selenium.webdriver.common.by import By
driver = webdriver.Chrome(ChromeDriverManager().install())
driver.get('https://www.priceking.com/')
driver.maximize_window()
driver.find_element(By.XPATH, "/html/body/div/center/font/a").click()
# driver.find_element(By.CSS_SELECTOR, "body > div > center > font > a").click()
這是我使用
uj5u.com熱心網友回復:
該元素Show More位于iframe. 需要切換到框架與元素進行互動。
# Imports required
from selenium.webdriver.common.by import By
from selenium.webdriver.support.wait import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
driver.get("https://www.priceking.com/")
wait = WebDriverWait(driver,30)
# Switch to Iframe
wait.until(EC.frame_to_be_available_and_switch_to_it((By.NAME,"contents")))
show_more = wait.until(EC.element_to_be_clickable((By.XPATH,"//a[contains(text(),'Show More')]")))
show_more.click()
# Can also use Link text to click on the element.
# show_more = wait.until(EC.element_to_be_clickable((By.LINK_TEXT,"Show More")))
# show_more.click()
# switch to default content
driver.switch_to.default_content()
uj5u.com熱心網友回復:
請wait在單擊鏈接之前使用一些陳述句,并且元素在內部,iframe因此首先切換到框架,然后單擊元素。
WebDriverWait(driver, 10).until(EC.frame_to_be_available_and_switch_to_it((By.NAME,"contents")))
WebDriverWait(driver, 10).until(EC.visibility_of_element_located((By.XPATH, "//a[text()=' Show More ']")))
driver.find_element(By.XPATH, "//a[text()=' Show More ']").click()
并且總是寫可靠 xPath
uj5u.com熱心網友回復:
- 該元素位于框架內,您需要切換到該框架才能訪問該元素。
- 在訪問元素之前,您必須添加一些等待/延遲。
- 定位器應該改進。
嘗試這個:
from selenium import webdriver
from webdriver_manager.chrome import ChromeDriverManager
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
driver = webdriver.Chrome(ChromeDriverManager().install())
driver.get('https://www.priceking.com/')
wait = WebDriverWait(driver, 20)
driver.maximize_window()
wait.until(EC.frame_to_be_available_and_switch_to_it((By.XPATH,"//frame[@name='contents']")))
wait.until(EC.visibility_of_element_located((By.XPATH, "//a[contains(text(),'Show More')]"))).click()
轉載請註明出處,本文鏈接:https://www.uj5u.com/caozuo/365326.html
標籤:Python 硒 网页抓取 内嵌框架 网络驱动程序等待
上一篇:使用BeautifulSoup從Coinmarketcap中抓取歷史位元幣資料
下一篇:Mechanize::ResponseCodeError(404=>Net::HTTPNotFound未處理的回應):
