主頁 > 軟體工程 > 從r中的網站抓取標題的問題

從r中的網站抓取標題的問題

2022-11-04 21:28:41 軟體工程

我正在嘗試從該網站提取所有標題:https ://www.theguardian.com/international 。我嘗試了很多 xpath,但沒有一個能成為頭條新聞,盡管代碼有效。關于我做錯了什么的任何想法?謝謝!

這是我的代碼:


guardian_url <- "https://www.theguardian.com/international"
guardian <- read_html(guardian_url)

headlines <- guardian %>% 
  html_elements(xpath = '//html/body/div[3]/div') %>% 
  html_text2()

uj5u.com熱心網友回復:

//a[@data-link-name='article'and not(contains(@class, 'u-faux-block-link__overlay'))]

這也會選擇標題和副標題。

uj5u.com熱心網友回復:

library(tidyverse)
library(rvest)
#> 
#> Attaching package: 'rvest'
#> The following object is masked from 'package:readr':
#> 
#>     guess_encoding

"https://www.theguardian.com/international" %>% 
  read_html %>% 
  html_elements(".fc-item__title") %>% 
  html_text2()

#>   [1] "UK Dover asylum centre not operating legally, concedes minister"                                                        
#>   [2] "Exclusive Bahraini death row prisoner pleads with pope to aid his release"                                              
#>   [3] "Live Russia-Ukraine war: Blinken hails Turkish help as grain export deal resumes"                                       
#>   [4] "‘We’re facing a defining moment’ Biden urges Americans to take a stand against political violence"                      
#>   [5] "Live UK: biggest interest rate rise in decades expected as Bank of England battles inflation"                           
#>   [6] "North Korea ICBM launch may have been a failure, South’s military says"                                                 
#>   [7] "Twitter Company may ‘halve its workforce’ as key investor backs job cuts"                                               
#>   [8] "China Father of three-year-old blames zero-Covid policy for son’s death"                                                
#>   [9] "Hong Kong Exiles in UK unnerved by ‘weak’ response to beating of protester"                                             
#>  [10] "Myanmar Experts warn of aid ‘catastrophe’, after junta law change"                                                      
#>  [11] "Analysis Grain deal U-turn offers lesson in calling Putin’s bluff"                                                      
#>  [12] "At a glance What we know on day 253 of the invasion"                                                                    
#>  [13] "UK Kremlin to summon British ambassador over drone attacks on Black Sea fleet"                                          
#>  [14] "Roman Abramovich UK adds two ‘business associates’ of former Chelsea owner to Russia sanctions list"                    
#>  [15] "‘He is poised to open the floodgates’ Can Twitter survive Elon Musk – or even thrive?"                                  
#>  [16] "The long read The many meanings of moss"                                                                                
#>  [17] "No fun rides but plenty of spirit Studio Ghibli offers anime fans a new walk in the park"                               
#>  [18] "Germany's balancing act Scholz heads to China amid questions over strategy"                                             
#>  [19] "Weird: The Al Yankovic Story review Daniel Radcliffe biopic packed with wacky walk-ons"                                 
#>  [20] "‘No darkness is for ever’ Can an activist in exile persuade the Taliban to allow teaching on TV?"                       
#>  [21] "Nil By Mouth review Gary Oldman’s overwhelming study of family violence"                                                
#>  [22] "‘More dignity’ Aid organisations switch to cash in drought-hit Ethiopia"                                                
#>  [23] "Europe Climate warming at twice rate of global average, says report"                                                    
#>  [24] "No more drinking water, little food: our island is a field of bones"                                                    
#>  [25] "Rishi Sunak PM U-turns on decision not to attend Cop27"                                                                 
#>  [26] "Cop27 Egyptian hunger striker may die in prison, Nobel laureates warn world leaders attending summit"                   
#>  [27] "Fossil fuel burning once caused a mass extinction – now we’re risking another"                                          
#>  [28] "World leaders at Cop27 in Egypt must demand the release of Alaa Abd El-Fattah"                                          
#>  [29] "The ProPublica-Vanity Fair report on Covid-19’s origins is explosive. Is it reliable?"                                  
#>  [30] "Benjamin Netanyahu may be back – but the true victory belongs to Israel’s far right"                                    
#>  [31] "Can you ‘lose’ an accent? And more importantly, why would you want to?"                                                 
#>  [32] "With the global economy on the rocks, quiet quitting is no longer a thing"                                              
#>  [33] "Qatar calling its critics racist opens a debate that may be worth having"                                               
#>  [34] "Pancakes, shakes and KFC When Barkley tried to eat his way out of the 76ers"                                            
#>  [35] "‘Any problem you have, it’s nothing’ Rico’s brotherly inspiration"                                                      
#>  [36] "World Series Astros silence Phillies in Game 4 with rare no-hitter"                                                     
#>  [37] "Cricket Yorkshire racism hearing to be held in public after request from Rafiq"                                         
#>  [38] "T20 World Cup Australia wary of ‘pushing too hard’ to improve run rate"                                                 
#>  [39] "Chelsea 2-1 Dinamo Zagreb Chilwell set to miss World Cup with hamstring injury"                                         
#>  [40] "To criticise or not to criticise Are women’s football pundits too nice?"                                                
#>  [41] "Europe French-German friendship ‘still alive’ as Macron meets Scholz amid tensions"                                     
#>  [42] "‘Nobody forced us’ The Greek builder who saved 80 Afghans from the sea"                                                 
#>  [43] "Italy Fall of Liz Truss gives far right a lesson in what not to do"                                                     
#>  [44] "‘Get Igor Girkin’ Hopes MH17 suspect could be captured fighting in Ukraine"                                             
#>  [45] "Israel election Netanyahu thanks voters as rightwing bloc extends Israeli election lead"                                
#>  [46] "Africa Invasive mosquito could disrupt ‘landscape of malaria’ after cases rise"                                         
#>  [47] "Twitter exodus Company faces murky future as top managers flee the nest"                                                
#>  [48] "Climate crisis Big agriculture warns farming must change or risk ‘destroying the planet’"                               
#>  [49] "Hillsong Church Founder Brian Houston breaks silence with video stating ‘I will fight’ criminal charge in Australia"    
#>  [50] "Denmark election Result keeps Social Democrats at the helm"                                                             
#>  [51] "Seoul crowd crush Local police offices raided in investigation"                                                         
#>  [52] "Exclusive UN poverty envoy tells Britain this is ‘worst time’ for more austerity"                                       
#>  [53] "Ethiopian civil war Parties agree truce to end hostilities"                                                             
#>  [54] "Just Stop Oil Protesters who targeted Girl with a Pearl Earring jailed by Dutch court"                                  
#>  [55] "Good Night Oppy review Cutesy Spielberg-assisted Mars documentary"                                                      
#>  [56] "Dinosaurs by Lydia Millet review Can a wealthy man be good?"                                                            
#>  [57] "‘Did I notice a dark side?’ The true story behind serial killer drama The Good Nurse"                                   
#>  [58] "Selena Gomez My Mind & Me review: a fascinating and frustrating pop doc"                                                
#>  [59] "Avatar: The Way of Water James Cameron releases extended trailer"                                                       
#>  [60] "Killer Sally review A warped true-crime tale of bodybuilder murder"                                                     
#>  [61] "How to cook the perfect ... Pumpkin gnocchi"                                                                            
#>  [62] "Rail route of the month The slow train to Skagen, Denmark, where the North Sea meets the Baltic"                        
#>  [63] "A moment that changed me I threw away the sheet music and all the colour and passion I had for the harp came back to me"
#>  [64] "Pushing Buttons Pushing Buttons: Freaky games form some of my most vivid childhood memories"                            
#>  [65] "Kitchen aide Why parmesan rinds are a cook’s secret ingredient"                                                         
#>  [66] "From pirates’ hideout to Dalí’s bolthole Cadaqués, star of Spain’s Costa Brava"                                         
#>  [67] "US midterm elections 2022 Republicans and Democrats spend big on ads"                                                   
#>  [68] "US midterm elections 2022 Why is Nike founder Phil Knight so desperate to prevent a Democratic win in Oregon?"          
#>  [69] "Cambodia’s modern slavery nightmare The human trafficking crisis overlooked by authorities"                             
#>  [70] "Psychology I was an unhappy teenager, among lonely people, in thrall to a charismatic leader – had I joined a cult?"    
#>  [71] "‘This is apartheid’ Cape Town slum residents condemn forced removals"                                                   
#>  [72] "‘I can’t work in the office safely’ The over-50s leaving the UK labour force"                                           
#>  [73] "Russians Tell us what you think about Putin’s escalation of war in Ukraine"                                             
#>  [74] "Iranians Share your views on the protests following Mahsa Amini’s death"                                                
#>  [75] "Tell us How have you been affected by the situation in Ukraine?"                                                        
#>  [76] "Get in touch Share a story with the Guardian"                                                                           
#>  [77] "Podcast Can Twitter survive Elon Musk? (And can Musk survive Twitter?)"                                                 
#>  [78] "Listen to previous episodes"                                                                                            
#>  [79] "Anywhere but Washington Moral panic, culture wars and Ron DeSantis: will Florida stay red in 2022?"                     
#>  [80] "Ukraine A village brutalised by Russia, and the youth rebuilding homes and hope"                                        
#>  [81] "Rishi Sunak How he became UK PM: three days in three minutes"                                                           
#>  [82] "China Could Xi follow Putin's example and try to annex Taiwan?"                                                         
#>  [83] "US Can abortion rights swing the midterm elections?"                                                                    
#>  [84] "Heating and eating Can cost of living and climate protesters join forces?"                                              
#>  [85] "Ukraine How Russia’s strategy failed, not the tank"                                                                     
#>  [86] "'I feel like the Beyoncé of Brazilian politics' The trans woman fighting back against Bolsonaro"                        
#>  [87] "Iran What the latest footage tells us about the regime"                                                                 
#>  [88] "Galloping horses, spears and adrenaline In tent pegging 'anything can happen'"                                          
#>  [89] "‘Extraordinary treasure trove’ Saul Leiter’s unseen images"                                                             
#>  [90] "Wednesday’s best photos Panda diplomacy and circus skills"                                                              
#>  [91] "The things left behind Seould police display belongings found after crowd crush – in pictures"                          
#>  [92] "Indigenous Australians Vigils held across Australia for Cassius Turvey"                                                 
#>  [93] "Village people The rituals of rural life"                                                                               
#>  [94] "Mexico Day of the Dead celebrations"                                                                                    
#>  [95] "Grain deal U-turn offers lesson in calling Vladimir Putin’s bluff"                                                      
#>  [96] "Live Russia-Ukraine war live news: Blinken hails Turkish help as grain export deal resumes"                             
#>  [97] "Hong Kong exiles in UK unnerved by ‘weak’ response to beating of protester"                                             
#>  [98] "‘We need your help’: young girl throws note over fence at Manston"                                                      
#>  [99] "North Korea ICBM launch may have been a failure, South’s military says"                                                 
#> [100] "Zelenskiy labels Putin U-turn on Ukraine grain deal a ‘failure of Russian aggression’"                                  
#> [101] "Bahraini death row prisoner pleads with pope to aid his release"                                                        
#> [102] "No more drinking water, little food: our island is a field of bones"                                                    
#> [103] "Russia-Ukraine war at a glance: what we know on day 253 of the invasion"                                                
#> [104] "Father of three-year-old blames China’s zero-Covid policy for son’s death"

使用reprex v2.0.2創建于 2022-11-03

轉載請註明出處,本文鏈接:https://www.uj5u.com/gongcheng/527422.html

標籤:r网页抓取路径

上一篇:通過更改Xpaths抓取資料

下一篇:不能報廢li并將結果放入BS中的dict中

標籤雲
其他(157675) Python(38076) JavaScript(25376) Java(17977) C(15215) 區塊鏈(8255) C#(7972) AI(7469) 爪哇(7425) MySQL(7132) html(6777) 基礎類(6313) sql(6102) 熊猫(6058) PHP(5869) 数组(5741) R(5409) Linux(5327) 反应(5209) 腳本語言(PerlPython)(5129) 非技術區(4971) Android(4554) 数据框(4311) css(4259) 节点.js(4032) C語言(3288) json(3245) 列表(3129) 扑(3119) C++語言(3117) 安卓(2998) 打字稿(2995) VBA(2789) Java相關(2746) 疑難問題(2699) 细绳(2522) 單片機工控(2479) iOS(2429) ASP.NET(2402) MongoDB(2323) 麻木的(2285) 正则表达式(2254) 字典(2211) 循环(2198) 迅速(2185) 擅长(2169) 镖(2155) 功能(1967) .NET技术(1958) Web開發(1951) python-3.x(1918) HtmlCss(1915) 弹簧靴(1913) C++(1909) xml(1889) PostgreSQL(1872) .NETCore(1853) 谷歌表格(1846) Unity3D(1843) for循环(1842)

熱門瀏覽
  • Git本地庫既關聯GitHub又關聯Gitee

    創建代碼倉庫 使用gitee舉例(github和gitee差不多) 1.在gitee右上角點擊+,選擇新建倉庫 ? 2.選擇填寫倉庫資訊,然后進行創建 ? 3.服務端已經準備好了,本地開始作準備 (1)Git 全域設定 git config --global user.name "成鈺" git c ......

    uj5u.com 2020-09-10 05:04:14 more
  • CODING DevOps 代碼質量實戰系列第二課,相約周三

    隨著 ToB(企業服務)的興起和 ToC(消費互聯網)產品進入成熟期,線上故障帶來的損失越來越大,代碼質量越來越重要,而「質量內建」正是 DevOps 核心理念之一。**《DevOps 代碼質量實戰(PHP 版)》**為 CODING DevOps 代碼質量實戰系列的第二課,同時也是本系列的 PHP ......

    uj5u.com 2020-09-10 05:07:43 more
  • 推薦Scrum書籍

    推薦Scrum書籍 直接上干貨,推薦書籍清單如下(推薦有順序的哦) Scrum指南 Scrum精髓 Scrum敏捷軟體開發 Scrum捷徑 硝煙中的Scrum和XP : 我們如何實施Scrum 敏捷軟體開發:Scrum實戰指南 Scrum要素 大規模Scrum:大規模敏捷組織的設計 用戶故事地圖 用 ......

    uj5u.com 2020-09-10 05:07:45 more
  • CODING DevOps 代碼質量實戰系列最后一課,周四發車

    隨著 ToB(企業服務)的興起和 ToC(消費互聯網)產品進入成熟期,線上故障帶來的損失越來越大,代碼質量越來越重要,而「質量內建」正是 DevOps 核心理念之一。 **《DevOps 代碼質量實戰(Java 版)》**為 CODING DevOps 代碼質量實戰系列的最后一課,同時也是本系列的 ......

    uj5u.com 2020-09-10 05:07:52 more
  • 敏捷軟體工程實踐書籍

    Scrum轉型想要做好,第一步先了解并真正落實Scrum,那么我推薦的Scrum書籍是要看懂并實踐的。第二步是團隊的工程實踐要做扎實。 下面推薦工程實踐書單: 重構:改善既有代碼的設計 決議極限編程 : 擁抱變化 代碼整潔代碼 程式員的職業素養 修改代碼的藝術 撰寫可讀代碼的藝術 測驗驅動開發 : ......

    uj5u.com 2020-09-10 05:07:55 more
  • Jenkins+svn+nginx實作windows環境自動部署vue前端專案

    前面文章介紹了Jenkins+svn+tomcat實作自動化部署,現在終于有空抽時間出來寫下Jenkins+svn+nginx實作自動部署vue前端專案。 jenkins的安裝和配置已經在前面文章進行介紹,下面介紹實作vue前端專案需要進行的哪些額外的步驟。 注意:在安裝jenkins和nginx的 ......

    uj5u.com 2020-09-10 05:08:49 more
  • CODING DevOps 微服務專案實戰系列第一課,明天等你

    CODING DevOps 微服務專案實戰系列第一課**《DevOps 微服務專案實戰:DevOps 初體驗》**將由 CODING DevOps 開發工程師 王寬老師 向大家介紹 DevOps 的基本理念,并探討為什么現代開發活動需要 DevOps,同時將以 eShopOnContainers 項 ......

    uj5u.com 2020-09-10 05:09:14 more
  • CODING DevOps 微服務專案實戰系列第二課來啦!

    近年來,工程專案的結構越來越復雜,需要接入合適的持續集成流水線形式,才能滿足更多變的需求,那么如何優雅地使用 CI 能力提升生產效率呢?CODING DevOps 微服務專案實戰系列第二課 《DevOps 微服務專案實戰:CI 進階用法》 將由 CODING DevOps 全堆疊工程師 何晨哲老師 向 ......

    uj5u.com 2020-09-10 05:09:33 more
  • CODING DevOps 微服務專案實戰系列最后一課,周四開講!

    隨著軟體工程越來越復雜化,如何在 Kubernetes 集群進行灰度發布成為了生產部署的”必修課“,而如何實作安全可控、自動化的灰度發布也成為了持續部署重點關注的問題。CODING DevOps 微服務專案實戰系列最后一課:**《DevOps 微服務專案實戰:基于 Nginx-ingress 的自動 ......

    uj5u.com 2020-09-10 05:10:00 more
  • CODING 儀表盤功能正式推出,實作作業資料可視化!

    CODING 儀表盤功能現已正式推出!該功能旨在用一張張統計卡片的形式,統計并展示使用 CODING 中所產生的資料。這意味著無需額外的設定,就可以收集歸納寶貴的作業資料并予之量化分析。這些海量的資料皆會以圖表或串列的方式躍然紙上,方便團隊成員隨時查看各專案的進度、狀態和指標,云端協作迎來真正意義上 ......

    uj5u.com 2020-09-10 05:11:01 more
最新发布
  • windows系統git使用ssh方式和gitee/github進行同步

    使用git來clone專案有兩種方式:HTTPS和SSH:
    HTTPS:不管是誰,拿到url隨便clone,但是在push的時候需要驗證用戶名和密碼;
    SSH:clone的專案你必須是擁有者或者管理員,而且需要在clone前添加SSH Key。SSH 在push的時候,是不需要輸入用戶名的,如果配置... ......

    uj5u.com 2023-04-19 08:41:12 more
  • windows系統git使用ssh方式和gitee/github進行同步

    使用git來clone專案有兩種方式:HTTPS和SSH:
    HTTPS:不管是誰,拿到url隨便clone,但是在push的時候需要驗證用戶名和密碼;
    SSH:clone的專案你必須是擁有者或者管理員,而且需要在clone前添加SSH Key。SSH 在push的時候,是不需要輸入用戶名的,如果配置... ......

    uj5u.com 2023-04-19 08:35:34 more
  • 2023年農牧行業6大CRM系統、5大場景盤點

    在物聯網、大資料、云計算、人工智能、自動化技術等現代資訊技術蓬勃發展與逐步成熟的背景下,數字化正成為農牧行業供給側結構性變革與高質量發展的核心驅動因素。因此,改造和提升傳統農牧業、開拓創新現代智慧農牧業,加快推進農牧業的現代化、資訊化、數字化建設已成為農牧業發展的重要方向。 當下,企業數字化轉型已經 ......

    uj5u.com 2023-04-18 08:05:44 more
  • 2023年農牧行業6大CRM系統、5大場景盤點

    在物聯網、大資料、云計算、人工智能、自動化技術等現代資訊技術蓬勃發展與逐步成熟的背景下,數字化正成為農牧行業供給側結構性變革與高質量發展的核心驅動因素。因此,改造和提升傳統農牧業、開拓創新現代智慧農牧業,加快推進農牧業的現代化、資訊化、數字化建設已成為農牧業發展的重要方向。 當下,企業數字化轉型已經 ......

    uj5u.com 2023-04-18 08:00:18 more
  • 計算機組成原理—存盤器

    計算機組成原理—硬體結構 二、存盤器 1.概述 存盤器是計算機系統中的記憶設備,用來存放程式和資料 1.1存盤器的層次結構 快取-主存層次主要解決CPU和主存速度不匹配的問題,速度接近快取 主存-輔存層次主要解決存盤系統的容量問題,容量接近與價位接近于主存 2.主存盤器 2.1概述 主存與CPU的聯 ......

    uj5u.com 2023-04-17 08:20:31 more
  • 談一談我對協同開發的一些認識

    如今各互聯網公司普通都使用敏捷開發,采用小步快跑的形式來進行專案開發。如果是小專案或者小需求,那一個開發可能就搞定了。但對于電商等復雜的系統,其功能多,結構復雜,一個人肯定是搞不定的,所以都是很多人來共同開發維護。以我曾經待過的商城團隊為例,光是后端開發就有七十多人。 為了更好地開發這類大型系統,往 ......

    uj5u.com 2023-04-17 08:18:55 more
  • 專案管理PRINCE2核心知識點整理

    PRINCE2,即 PRoject IN Controlled Environment(受控環境中的專案)是一種結構化的專案管理方法論,由英國政府內閣商務部(OGC)推出,是英國專案管理標準。
    PRINCE2 作為一種開放的方法論,是一套結構化的專案管理流程,描述了如何以一種邏輯性的、有組織的方法,... ......

    uj5u.com 2023-04-17 08:18:51 more
  • 談一談我對協同開發的一些認識

    如今各互聯網公司普通都使用敏捷開發,采用小步快跑的形式來進行專案開發。如果是小專案或者小需求,那一個開發可能就搞定了。但對于電商等復雜的系統,其功能多,結構復雜,一個人肯定是搞不定的,所以都是很多人來共同開發維護。以我曾經待過的商城團隊為例,光是后端開發就有七十多人。 為了更好地開發這類大型系統,往 ......

    uj5u.com 2023-04-17 08:18:00 more
  • 專案管理PRINCE2核心知識點整理

    PRINCE2,即 PRoject IN Controlled Environment(受控環境中的專案)是一種結構化的專案管理方法論,由英國政府內閣商務部(OGC)推出,是英國專案管理標準。
    PRINCE2 作為一種開放的方法論,是一套結構化的專案管理流程,描述了如何以一種邏輯性的、有組織的方法,... ......

    uj5u.com 2023-04-17 08:17:55 more
  • 計算機組成原理—存盤器

    計算機組成原理—硬體結構 二、存盤器 1.概述 存盤器是計算機系統中的記憶設備,用來存放程式和資料 1.1存盤器的層次結構 快取-主存層次主要解決CPU和主存速度不匹配的問題,速度接近快取 主存-輔存層次主要解決存盤系統的容量問題,容量接近與價位接近于主存 2.主存盤器 2.1概述 主存與CPU的聯 ......

    uj5u.com 2023-04-17 08:12:06 more