如何使用python和bs4從這個html標簽中抓取資料

我能夠成功抓取資料，我想如何將其寫入 csv 檔案（逗號分隔）

我想提取類“ui-h2”、“help__content help__content--small”和“exam-name”的元素。我有代碼，但作為我想要的輸出

• 2022 年 4 月，2022 年 4 月 3 日，UPPSC ACF RFO 電源
• 2022 年 4 月，2022 年 4 月 3 日，MPSC C 組

<div class="item-name" data-toggle="collapse" data-target="#exam-4" aria-expanded=false>
  <div class="ui-h2">April 2022 <span class="ui-tag grey-transparent">14 Exams</span></div>
</div>
<div class="item-details collapse " id="exam-4" data-parent="#exam-month">
  <div class="row">
      <div class="col-12 col-lg-4">
          <div class="ui-card hover-scale">
              <a href="https://testbook.com/uppsc-acf-rfo" class="card-link exam-cards">
                  <div>
                      <span class="icon calendar-icon"></span>
                      <span class="help__content help__content--small">3 Apr 2022</span>
                      <span class="ui-tag green-filled">Official</span>
                  </div>
                  <div class="footer-container">
                      <span class="exam-icon">
                      <img src="https://blogmedia.testbook.com/blog/wp-content/uploads/2020/06/uttar-pradesh-logo-png-8-5bbbec3b.png" height="30">
                      </span>
                      <span class="exam-name" title="UPPSC ACF RFO Mains">UPPSC ACF RFO Mains</span>
                      <span class="exam-cta">
                      Know More <span class="right-icon"></span>
                      </span>
                  </div>
              </a>
          </div>
      </div>
      <div class="col-12 col-lg-4">
          <div class="ui-card hover-scale">
              <a href="https://testbook.com/mpsc-group-c" class="card-link exam-cards">
                  <div>
                      <span class="icon calendar-icon"></span>
                      <span class="help__content help__content--small">3 Apr 2022</span>
                      <span class="ui-tag green-filled">Official</span>
                  </div>
                  <div class="footer-container">
                      <span class="exam-icon">
                      <img src="https://blogmedia.testbook.com/blog/wp-content/uploads/2020/03/mpsc-logo-1-44a80da2.png" height="30">
                      </span>
                      <span class="exam-name" title="MPSC Group C">MPSC Group C</span>
                      <span class="exam-cta">
                      Know More <span class="right-icon"></span>
                      </span>
                  </div>
              </a>
          </div>
      </div>
</div>
</div>

for contents in soup.find_all("div", {"class":"ui-h2"}):
    #print(contents)
    if contents.text is not None:
            #print(contents.text)
            f.write(contents.text "-")

    for contentspan2 in soup.find_all("span", {"class":"help__content help__content--small"}):
        
        if contentspan2.string is not None:
            #print(contentspan2.string)
            f.write(contentspan2.string ",")
            

        for contentspan in soup.find_all("span", {"class":"exam-name"}):
        
            if contentspan.string is not None:
                #print(contentspan.string)
                f.write(contentspan.string "\n")

uj5u.com熱心網友回復：

構造要寫入檔案的行串列。串列中的每個元素都是一個字典，其中鍵：值作為列名：值。然后讓熊貓做這項作業。

因此，鑒于您提供的 html：

soup = BeautifulSoup(html, 'html.parser')
rows = soup.find_all('div', {'class':'row'})

rowList = []
for row in rows:
    cards = row.find_all('div', {'class':re.compile("^ui-card")})
    for card in cards:
        dateStr = card.find('span',{'class':re.compile("^help__content")}).text.strip()
        examName = card.find('span', {'class':'exam-name'}).text
        rowList.append({'date':dateStr,
                        'exam':examName})

df = pd.DataFrame(rowList)
df.to_csv('filename.csv', index=False)

輸出：

print(df)
         date                 exam
0  3 Apr 2022  UPPSC ACF RFO Mains
1  3 Apr 2022         MPSC Group C

標籤：Python 网页抓取 美丽的汤

上一篇：抓取同一標題/類下的多個錨標記

下一篇：網頁抓取BeautifulSoup