如何從嵌套在帶有Selenium的tr標簽內的選擇標簽中檢索資料？

我希望每個人都做得很好！

我有一個任務，我不太清楚如何解決它。所以讓我從頭開始：

1. 我想從網頁（地圖）中洗掉有關街道和相關號碼的詳細資訊。對于這份作業，我選擇了 Selenium。我看了一些教程和不同的答案，但沒有成功。

第一部分，是檢索街道。這部分我設法完成了。頁面如下所示：

所以有一個帶有一堆<tr>標簽的表，我設法從中檢索到所需的資料。然而，一旦我需要找到一種方法來檢索數字，事情就變得有點復雜了。街道編號位于<select>標簽中，僅當我單擊給定標簽時才會出現。所以，從上一張圖來看，結構變成了這樣：

But again, only IF I click on the <tr> tag. If I click another <tr> tag, the <select> tag from the previous <tr> disappears, and pops to the one selected with corresponding <option> tags.

Now, my question is: How can I iterate through entire table, click on each <tr> and IF a <select> tag pops up, to retrieve the numbers associated to each Street?

I would like to store the result in a dictionary where the key is the name of the street, and as values, the numbers associated.

So far, this is the code I wrote, which of course, fails to solve my problem.

UPDATE 3:

driver = webdriver.Chrome(service=Service(path_ex))

driver.get("https://cluj-city.map2web.eu/")

wait = WebDriverWait(driver,30)

# panel = driver.find_element(By.CSS_SELECTOR,"h4#titleStreets")
panel = wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR,"h4#titleStreets")))
panel.click()

streets = driver.find_elements(By.XPATH,"//table[@id='streets']/tbody/tr/td")

# for i in range(len(streets)):
for i in range(10): # Tried for 10 elements.
    streets = driver.find_elements(By.XPATH, "//table[@id='streets']/tbody/tr")
    print(streets[i].find_element(By.XPATH,"./td").text)
    streets[i].find_element(By.XPATH,"./td").click()
    time.sleep(2)
    try:
        numbers = streets[i].find_elements(By.XPATH,"./td/select/option")
        num_list = []
        for i in range(len(numbers)):
            num_list.append(numbers[i].get_attribute("value"))
        print(num_list)
    except:
        print("No numbers")

Error I get

Traceback (most recent call last):
  File "/home/tudor/PycharmProjects/pythonProject/beat.py", line 18, in <module>
    panel = wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR,"h4#titleStreets")))
  File "/home/tudor/PycharmProjects/pythonProject/venv/lib/python3.9/site-packages/selenium/webdriver/support/wait.py", line 89, in until
    raise TimeoutException(message, screen, stacktrace)
selenium.common.exceptions.TimeoutException: Message: 

uj5u.com熱心網友回復：

嘗試如下一次并確認。

driver.get("https://cluj-city.map2web.eu/")

wait = WebDriverWait(driver,30)

# panel = driver.find_element(By.CSS_SELECTOR,"h4#titleStreets")
panel = wait.until(EC.element_to_be_clickable((By.CSS_SELECTOR,"h4#titleStreets")))
panel.click()

streets = driver.find_elements(By.XPATH,"//table[@id='streets']/tbody/tr/td")

# for i in range(len(streets)):
for i in range(10): # Tried for 10 elements.
    streets = driver.find_elements(By.XPATH, "//table[@id='streets']/tbody/tr")
    print(streets[i].find_element(By.XPATH,"./td").text)
    streets[i].find_element(By.XPATH,"./td").click()
    time.sleep(2)
    try:
        numbers = streets[i].find_elements(By.XPATH,"./td/select/option")
        num_list = []
        for i in range(len(numbers)):
            num_list.append(numbers[i].get_attribute("value"))
        print(num_list)
    except:
        print("No numbers")

輸出

Aleea Alb?strelelor
[]
Aleea Alexandru Lapedatu
['0', '672723', '673946', '672724', '686707', '685369', '674092', '685370', '674093', '685371', '685379', '686708', '674094', '686710', '686711']
Aleea Anemonelor
['0', '674371']
Aleea Azaleelor
['0', '686876', '686847', '667291', '669662', '686877', '686878']
Aleea Azuga
['0', '675419', '661994', '676263', '662870', '666294', '665524', '675422', '662090']
Aleea Azur
[]
Aleea B?i?oara
['0', '675416', '685313', '662861', '673532', '665446', '675426', '678804', '663696', '661674', '661988', '672374', '675431']
Aleea B?i?a
['0', '666522', '678447', '661990', '662881', '661992', '661993', '665375', '662880', '661987', '661995', '676267']
Aleea Balea
['0', '676268', '676266', '662865', '662866', '663658', '665715', '686000', '686014', '686012', '686013', '686015', '673391', '686019', '686020', '686007', '686801', '686010', '662878']
Aleea Barsei
['0', '663687', '675417', '662871', '676265', '663692']

標籤：python selenium web-scraping

上一篇：XPath找不到元素

下一篇：在Python中作業應用機器人面臨IndexError：串列索引超出范圍