主頁 > 軟體工程 > 當硬編碼延遲未到位時,腳本無法從網頁生成描述

當硬編碼延遲未到位時,腳本無法從網頁生成描述

2022-01-09 23:11:59 軟體工程

我正在嘗試從網頁中獲取結果的標題和描述單擊標題時會顯示描述。以下腳本僅在我在單擊后定義硬編碼延遲時才有效。但是,我希望擺脫腳本中的硬編碼延遲。

import time
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

link = 'https://innovation.ised-isde.canada.ca/s/list-liste?language=en_CA&token=a0B5W000000WsFSUA0'

driver = webdriver.Chrome()
wait = WebDriverWait(driver,10)
driver.get(link)

for i,item in enumerate(wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR,".advanced-results .h4")))):
    driver.execute_script("arguments[0].click();",item)
    title = item.text
    time.sleep(2)
    desc = wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR,"p.program-dov-description")))[i].text
    print(title,desc)
    print()

driver.quit()

如何在不使用硬編碼延遲的情況下從該網頁獲取標題和描述?

uj5u.com熱心網友回復:

這應該有效。問題是我不知道如何使用 css_selector 獲取多個元素,所以我信任我的老朋友 xpath,所以我獲取了結果,而沒有time.sleep按要求使用我收到你的這行錯誤,指出該元素不可下標,因為[i],但我的 xpath 有效。

desc = wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR,"p.program-dov-description")))[i].text
    print(title,desc)

這是重構后的代碼:

import time
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
from webdriver_manager.chrome import ChromeDriverManager

link = 'https://innovation.ised-isde.canada.ca/s/list-liste?language=en_CA&token=a0B5W000000WsFSUA0'

driver = webdriver.Chrome(ChromeDriverManager().install())
wait = WebDriverWait(driver,10)
driver.get(link)

for i,item in enumerate(wait.until(EC.presence_of_all_elements_located((By.CSS_SELECTOR,".advanced-results .h4")))):
    # print(i, item)
    driver.execute_script("arguments[0].click();",item)
    title = item.text
    desc_text = "//*[@class='program-dov-description']"
    desc = wait.until(EC.visibility_of_element_located((By.XPATH,'('   desc_text   ')'   '['   str(i 1)   ']' ))).text
    print(title,desc)
    print()

driver.quit()

輸出(粘貼部分輸出以節省空間)

Income support for sick or self-isolating workers Get up to $500 per week for six weeks if you are employed or self-employed and need to take time off because you’re sick or need to self-isolate due to COVID-19 or have an underlying medical condition that puts you at higher risks of getting COVID-19.

Income support to care for dependent family members Get up to $500 per week for up to 44 weeks, per household, if you haven’t been able to work for at least 50% of your normal work week because you are caring for children under 12 years old or other dependent family members because of COVID-19.

Support for businesses to avoid layoffs If your employees are eligible for Employment Insurance (EI) benefits, and your business is suffering a downturn due to COVID-19, you can apply for a work-sharing agreement. The agreement would allow your employees to work a temporarily reduced work week while receiving EI benefits.

uj5u.com熱心網友回復:

wait=WebDriverWait(driver,30)                                 
driver.get('https://innovation.ised-isde.canada.ca/s/list-liste?language=en_CA&token=a0B5W000000WsFSUA0')
elements=wait.until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR,"div.cIC_DraggableList.cIC_Dovs > div")))
for x in elements:
    x.click()
    time.sleep(1)
title=[x.get_attribute("data-dovtitle") for x in wait.until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR,"div.row.mh-0 button:nth-child(2)")))]
desc=[x.text for x in wait.until(EC.visibility_of_all_elements_located((By.CSS_SELECTOR,"p.program-dov-description")))]
    
print(list(zip(title,desc)))

因此,只需單擊并打開每一個并收集它們的標題和描述。

進口:

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait 
from selenium.webdriver.support import expected_conditions as EC

輸出:

[('Canada Recovery Sickness Benefit', 'Get up to $500 per week for six weeks if you are employed or self-employed and need to take time off because you’re sick or need to self-isolate due to COVID-19 or have an underlying medical condition that puts you at higher risks of getting COVID-19.'), ('Canada Recovery Caregiver Benefit', 'Get up to $500 per week for up to 44 weeks, per household, if you haven’t been able to work for at least 50% of your normal work week because you are caring for children under 12 years old or other dependent family members because of COVID-19.'), ('Work-Sharing program — COVID-19', 'If your employees are eligible for Employment Insurance (EI) benefits, and your business is suffering a downturn due to COVID-19, you can apply for a work-sharing agreement. The agreement would allow your employees to work a temporarily reduced work week while receiving EI benefits.'), ('Workplace screening of employees', 'Get free rapid tests to help identify employees who may be infected with COVID-19 but have no symptoms. Rapid tests are safe, easy to administer and provide results in 15 minutes.'), ('Canada Emergency Rent Subsidy (CERS)', 'If your business has been impacted by COVID-19, you could get a retroactive rent subsidy that covers up to 65% of eligible expenses to a maximum of $75,000 per business location, and $300,000 in total for all locations, with additional amounts for temporary closures.'), ('BDC Co-Lending Program (BCAP)', 'If your business has been affected by COVID-19, you could get up to $12.5 million to support your operational cash flow, co-financed by BDC and your primary lending institution.'), ('Essential Services Contingency Reserve', 'If you’re an essential business and can’t get personal protective equipment for your workers through other means, you can purchase from Canada’s reserve on a cost-recovery basis.'), ('Accelerate HER PEI', "Take part in a 12-week pilot program (virtually or in person) that includes one-on-one mentorship, peer support, market research guidance and more. Learn how to grow your business whether you're in the early stage of development or taking your business in a new direction."), ('Indigenous Community Business Fund — Stream 2', 'Get a non-repayable contribution to cover eligible operating costs if your Indigenous business has experienced a significant reduction in revenues due to COVID-19.'), ('COVID-19: Waiving tariffs on certain medical goods', 'If your business imported certain medical items into Canada on or after May 5, 2020, including PPE (masks, gloves, garments, sterilization products), you will not have to pay tariffs on those items.'), ('Mortgage Payment Deferral', 'If you have experienced financial hardship due to COVID-19, you may be eligible for deferred payments on your insured home mortgage, for a specified amount of time, through your lender.'), ('COVID-19 Support: Futurpreneur Canada', 'If you received a start-up loan from Futurpreneur prior to April 1, 2020, your payments will be covered from March 25 through to September 24, 2020. If you do not qualify for the Canadian Emergency Business Account, you can top up your loan to a maximum of $10,000, interest-free, with one year of deferred repayment, to help cover operating costs during this challenging period.'), ('COVID-19: ExploreIP', 'Search this database for available patents related to COVID-19 for licensing or collaboration opportunities with public sector patent holders. Filter your search results by technology, expertise, or location.'), ('Community Futures Network of Canada', 'If your business is located in a rural community, and doesn’t qualify for the federal wage subsidy or other supports, you may be eligible for financial assistance through your Community Futures Network Canada.'), ('Regional development agencies: COVID-19 support', 'If the COVID-19 pandemic is affecting your operations, contact your local Regional Development Agency office to get a review of your situation and guidance on getting funding, support and/or flexible arrangements, on a case-by-case basis.'), ('Smart Renewables and Electrification Pathways Program', 'Get a repayable contribution of up to $50 million for a project that involves renewable energy, an emerging technology, or grid modernization, and covers up to 10%, 30% and 50% of the project costs for each of these 3 streams, respectively.'), ('COVID-19 and Your Business newsletter', 'Subscribe to receive timely information from the federal government on keeping your workers safe, receiving your vaccine and finding the support you need.'), ('PPE Supply Hub', 'Whether you’re selling personal protective equipment (PPE) during the COVID-19 pandemic, or looking for PPE to protect your workers, you can use this hub that connects buyers and sellers.'), ('BDC Capital Bridge Financing Program', 'If you operate a high-growth company that has been specifically impacted by COVID-19, you could get matched financing of at least $500,000 in the form of a convertible note if you are already backed by a qualified venture capital firm and have raised at least $500,000 in external capital.'), ('Temporary Wage Subsidy for Employers', 'Get a wage subsidy of up to $25,000 to cover 10% of the remuneration you paid from March 18, 2020 to June 19, 2020, up to $1,375 per eligible employee.'), ('Innovation Canada — Innovation Advisors', "If you're developing a new product, technology or process, an Innovation Advisor can provide you with free, one-on-one assistance to help you find the government supports that are right for your business. Our advisors are former entrepreneurs with established networks in both private and public sectors, and can help put you in touch with specialists in finance, technical advice and foreign market expertise, to help your business grow from here. Innovation Advisors help companies that are incorporated for profit in Canada. Is this you?")]

轉載請註明出處,本文鏈接:https://www.uj5u.com/gongcheng/406653.html

標籤:

上一篇:如何獲取DelphiProjectsMRUList?

下一篇:PythonSelenium索引嵌套元素

標籤雲
其他(157675) Python(38076) JavaScript(25376) Java(17977) C(15215) 區塊鏈(8255) C#(7972) AI(7469) 爪哇(7425) MySQL(7132) html(6777) 基礎類(6313) sql(6102) 熊猫(6058) PHP(5869) 数组(5741) R(5409) Linux(5327) 反应(5209) 腳本語言(PerlPython)(5129) 非技術區(4971) Android(4554) 数据框(4311) css(4259) 节点.js(4032) C語言(3288) json(3245) 列表(3129) 扑(3119) C++語言(3117) 安卓(2998) 打字稿(2995) VBA(2789) Java相關(2746) 疑難問題(2699) 细绳(2522) 單片機工控(2479) iOS(2429) ASP.NET(2402) MongoDB(2323) 麻木的(2285) 正则表达式(2254) 字典(2211) 循环(2198) 迅速(2185) 擅长(2169) 镖(2155) 功能(1967) .NET技术(1958) Web開發(1951) python-3.x(1918) HtmlCss(1915) 弹簧靴(1913) C++(1909) xml(1889) PostgreSQL(1872) .NETCore(1853) 谷歌表格(1846) Unity3D(1843) for循环(1842)

熱門瀏覽
  • Git本地庫既關聯GitHub又關聯Gitee

    創建代碼倉庫 使用gitee舉例(github和gitee差不多) 1.在gitee右上角點擊+,選擇新建倉庫 ? 2.選擇填寫倉庫資訊,然后進行創建 ? 3.服務端已經準備好了,本地開始作準備 (1)Git 全域設定 git config --global user.name "成鈺" git c ......

    uj5u.com 2020-09-10 05:04:14 more
  • CODING DevOps 代碼質量實戰系列第二課,相約周三

    隨著 ToB(企業服務)的興起和 ToC(消費互聯網)產品進入成熟期,線上故障帶來的損失越來越大,代碼質量越來越重要,而「質量內建」正是 DevOps 核心理念之一。**《DevOps 代碼質量實戰(PHP 版)》**為 CODING DevOps 代碼質量實戰系列的第二課,同時也是本系列的 PHP ......

    uj5u.com 2020-09-10 05:07:43 more
  • 推薦Scrum書籍

    推薦Scrum書籍 直接上干貨,推薦書籍清單如下(推薦有順序的哦) Scrum指南 Scrum精髓 Scrum敏捷軟體開發 Scrum捷徑 硝煙中的Scrum和XP : 我們如何實施Scrum 敏捷軟體開發:Scrum實戰指南 Scrum要素 大規模Scrum:大規模敏捷組織的設計 用戶故事地圖 用 ......

    uj5u.com 2020-09-10 05:07:45 more
  • CODING DevOps 代碼質量實戰系列最后一課,周四發車

    隨著 ToB(企業服務)的興起和 ToC(消費互聯網)產品進入成熟期,線上故障帶來的損失越來越大,代碼質量越來越重要,而「質量內建」正是 DevOps 核心理念之一。 **《DevOps 代碼質量實戰(Java 版)》**為 CODING DevOps 代碼質量實戰系列的最后一課,同時也是本系列的 ......

    uj5u.com 2020-09-10 05:07:52 more
  • 敏捷軟體工程實踐書籍

    Scrum轉型想要做好,第一步先了解并真正落實Scrum,那么我推薦的Scrum書籍是要看懂并實踐的。第二步是團隊的工程實踐要做扎實。 下面推薦工程實踐書單: 重構:改善既有代碼的設計 決議極限編程 : 擁抱變化 代碼整潔代碼 程式員的職業素養 修改代碼的藝術 撰寫可讀代碼的藝術 測驗驅動開發 : ......

    uj5u.com 2020-09-10 05:07:55 more
  • Jenkins+svn+nginx實作windows環境自動部署vue前端專案

    前面文章介紹了Jenkins+svn+tomcat實作自動化部署,現在終于有空抽時間出來寫下Jenkins+svn+nginx實作自動部署vue前端專案。 jenkins的安裝和配置已經在前面文章進行介紹,下面介紹實作vue前端專案需要進行的哪些額外的步驟。 注意:在安裝jenkins和nginx的 ......

    uj5u.com 2020-09-10 05:08:49 more
  • CODING DevOps 微服務專案實戰系列第一課,明天等你

    CODING DevOps 微服務專案實戰系列第一課**《DevOps 微服務專案實戰:DevOps 初體驗》**將由 CODING DevOps 開發工程師 王寬老師 向大家介紹 DevOps 的基本理念,并探討為什么現代開發活動需要 DevOps,同時將以 eShopOnContainers 項 ......

    uj5u.com 2020-09-10 05:09:14 more
  • CODING DevOps 微服務專案實戰系列第二課來啦!

    近年來,工程專案的結構越來越復雜,需要接入合適的持續集成流水線形式,才能滿足更多變的需求,那么如何優雅地使用 CI 能力提升生產效率呢?CODING DevOps 微服務專案實戰系列第二課 《DevOps 微服務專案實戰:CI 進階用法》 將由 CODING DevOps 全堆疊工程師 何晨哲老師 向 ......

    uj5u.com 2020-09-10 05:09:33 more
  • CODING DevOps 微服務專案實戰系列最后一課,周四開講!

    隨著軟體工程越來越復雜化,如何在 Kubernetes 集群進行灰度發布成為了生產部署的”必修課“,而如何實作安全可控、自動化的灰度發布也成為了持續部署重點關注的問題。CODING DevOps 微服務專案實戰系列最后一課:**《DevOps 微服務專案實戰:基于 Nginx-ingress 的自動 ......

    uj5u.com 2020-09-10 05:10:00 more
  • CODING 儀表盤功能正式推出,實作作業資料可視化!

    CODING 儀表盤功能現已正式推出!該功能旨在用一張張統計卡片的形式,統計并展示使用 CODING 中所產生的資料。這意味著無需額外的設定,就可以收集歸納寶貴的作業資料并予之量化分析。這些海量的資料皆會以圖表或串列的方式躍然紙上,方便團隊成員隨時查看各專案的進度、狀態和指標,云端協作迎來真正意義上 ......

    uj5u.com 2020-09-10 05:11:01 more
最新发布
  • windows系統git使用ssh方式和gitee/github進行同步

    使用git來clone專案有兩種方式:HTTPS和SSH:
    HTTPS:不管是誰,拿到url隨便clone,但是在push的時候需要驗證用戶名和密碼;
    SSH:clone的專案你必須是擁有者或者管理員,而且需要在clone前添加SSH Key。SSH 在push的時候,是不需要輸入用戶名的,如果配置... ......

    uj5u.com 2023-04-19 08:41:12 more
  • windows系統git使用ssh方式和gitee/github進行同步

    使用git來clone專案有兩種方式:HTTPS和SSH:
    HTTPS:不管是誰,拿到url隨便clone,但是在push的時候需要驗證用戶名和密碼;
    SSH:clone的專案你必須是擁有者或者管理員,而且需要在clone前添加SSH Key。SSH 在push的時候,是不需要輸入用戶名的,如果配置... ......

    uj5u.com 2023-04-19 08:35:34 more
  • 2023年農牧行業6大CRM系統、5大場景盤點

    在物聯網、大資料、云計算、人工智能、自動化技術等現代資訊技術蓬勃發展與逐步成熟的背景下,數字化正成為農牧行業供給側結構性變革與高質量發展的核心驅動因素。因此,改造和提升傳統農牧業、開拓創新現代智慧農牧業,加快推進農牧業的現代化、資訊化、數字化建設已成為農牧業發展的重要方向。 當下,企業數字化轉型已經 ......

    uj5u.com 2023-04-18 08:05:44 more
  • 2023年農牧行業6大CRM系統、5大場景盤點

    在物聯網、大資料、云計算、人工智能、自動化技術等現代資訊技術蓬勃發展與逐步成熟的背景下,數字化正成為農牧行業供給側結構性變革與高質量發展的核心驅動因素。因此,改造和提升傳統農牧業、開拓創新現代智慧農牧業,加快推進農牧業的現代化、資訊化、數字化建設已成為農牧業發展的重要方向。 當下,企業數字化轉型已經 ......

    uj5u.com 2023-04-18 08:00:18 more
  • 計算機組成原理—存盤器

    計算機組成原理—硬體結構 二、存盤器 1.概述 存盤器是計算機系統中的記憶設備,用來存放程式和資料 1.1存盤器的層次結構 快取-主存層次主要解決CPU和主存速度不匹配的問題,速度接近快取 主存-輔存層次主要解決存盤系統的容量問題,容量接近與價位接近于主存 2.主存盤器 2.1概述 主存與CPU的聯 ......

    uj5u.com 2023-04-17 08:20:31 more
  • 談一談我對協同開發的一些認識

    如今各互聯網公司普通都使用敏捷開發,采用小步快跑的形式來進行專案開發。如果是小專案或者小需求,那一個開發可能就搞定了。但對于電商等復雜的系統,其功能多,結構復雜,一個人肯定是搞不定的,所以都是很多人來共同開發維護。以我曾經待過的商城團隊為例,光是后端開發就有七十多人。 為了更好地開發這類大型系統,往 ......

    uj5u.com 2023-04-17 08:18:55 more
  • 專案管理PRINCE2核心知識點整理

    PRINCE2,即 PRoject IN Controlled Environment(受控環境中的專案)是一種結構化的專案管理方法論,由英國政府內閣商務部(OGC)推出,是英國專案管理標準。
    PRINCE2 作為一種開放的方法論,是一套結構化的專案管理流程,描述了如何以一種邏輯性的、有組織的方法,... ......

    uj5u.com 2023-04-17 08:18:51 more
  • 談一談我對協同開發的一些認識

    如今各互聯網公司普通都使用敏捷開發,采用小步快跑的形式來進行專案開發。如果是小專案或者小需求,那一個開發可能就搞定了。但對于電商等復雜的系統,其功能多,結構復雜,一個人肯定是搞不定的,所以都是很多人來共同開發維護。以我曾經待過的商城團隊為例,光是后端開發就有七十多人。 為了更好地開發這類大型系統,往 ......

    uj5u.com 2023-04-17 08:18:00 more
  • 專案管理PRINCE2核心知識點整理

    PRINCE2,即 PRoject IN Controlled Environment(受控環境中的專案)是一種結構化的專案管理方法論,由英國政府內閣商務部(OGC)推出,是英國專案管理標準。
    PRINCE2 作為一種開放的方法論,是一套結構化的專案管理流程,描述了如何以一種邏輯性的、有組織的方法,... ......

    uj5u.com 2023-04-17 08:17:55 more
  • 計算機組成原理—存盤器

    計算機組成原理—硬體結構 二、存盤器 1.概述 存盤器是計算機系統中的記憶設備,用來存放程式和資料 1.1存盤器的層次結構 快取-主存層次主要解決CPU和主存速度不匹配的問題,速度接近快取 主存-輔存層次主要解決存盤系統的容量問題,容量接近與價位接近于主存 2.主存盤器 2.1概述 主存與CPU的聯 ......

    uj5u.com 2023-04-17 08:12:06 more