我想在抓取這些網址之間添加等待。我想每分鐘抓取 2 個 url,所以等待 30 秒就足夠了,但不知道如何在 url 之間添加等待。新手在這里感謝您的幫助!
import cloudscraper
from bs4 import BeautifulSoup
scraper = cloudscraper.create_scraper()
urls = ["https://www.brandbucket.com/names?page=1","https://www.brandbucket.com/names?page=2","https://www.brandbucket.com/names?page=3","https://www.brandbucket.com/names?page=4","https://www.brandbucket.com/names?page=5"]
for url in urls:
r = scraper.get(url)
html = r.content
soup = BeautifulSoup(html, 'html.parser')
titles = soup.find_all("div", class_="domainCardDetail")
for title in titles:
print(title.text)
uj5u.com熱心網友回復:
您可以使用time.sleep()
匯入時間模塊
import time
然后使用
time.sleep("number of seconds you want to wait")
轉載請註明出處,本文鏈接:https://www.uj5u.com/shujuku/434646.html
上一篇:C#字典到物件陣列
