我想從這個標簽中抓取流派和藝術家資訊：
<script type="text/javascript">
window.rtkGPTSlotsTargeting = [
[
["genre", "pop"],
["artist", "a1"]
]
];
</script>
我用這段代碼試了一下：
from fake_useragent import UserAgent
import requests
from bs4 import BeautifulSoup
import json
link = "https://www.azlyrics.com/lyrics/a1/foreverinlove.html"
ua = UserAgent()
userAgent = ua.random
HEADERS = {"User-Agent": userAgent}
page = requests.get (link, headers=HEADERS)
soup = BeautifulSoup (page.content, "html.parser")
tmpScript = soup.find("script")
data = json.loads(tmpScript.string)
print(data)
但我總是得到這個錯誤：
$ python collLyrics.py
Traceback (most recent call last):
File "C:\Users\Polzi\Documents\DEV\Fiverr\TRY\kushabateni\collLyrics.py", line 14, in <module>
data = json.loads(tmpScript.string)
File "c:\users\polzi\appdata\local\programs\python\python39\lib\json\__init__.py", line 346, in loads
return _default_decoder.decode(s)
File "c:\users\polzi\appdata\local\programs\python\python39\lib\json\decoder.py", line 337, in decode
obj, end = self.raw_decode(s, idx=_w(s, 0).end())
File "c:\users\polzi\appdata\local\programs\python\python39\lib\json\decoder.py", line 355, in raw_decode
raise JSONDecodeError("Expecting value", s, err.value) from None
json.decoder.JSONDecodeError: Expecting value: line 2 column 1 (char 2)
(NormalScraping)
如何從標簽中獲取這 2 個資訊？
uj5u.com熱心網友回復：
您可以使用正則運算式模式來查找正確的資料：
\[.*\]
將搜索括號內的所有文本：
from fake_useragent import UserAgent
import requests
from bs4 import BeautifulSoup
import re
link = "https://www.azlyrics.com/lyrics/a1/foreverinlove.html"
ua = UserAgent()
userAgent = ua.random
HEADERS = {"User-Agent": userAgent}
page = requests.get(link, headers=HEADERS)
soup = BeautifulSoup(page.content, "html.parser")
tmpScript = soup.find("script")
for tag in re.findall(r"(\[.*\])", tmpScript.string):
print(tag)
輸出：
["genre", "pop"]
["artist", "a1"]
uj5u.com熱心網友回復：
有點“怪異”的解決方案，但仍能獲得所需的輸出。
import json
import re
import requests
from bs4 import BeautifulSoup
data = (
json.loads(
re.search(
r"= \[(.*)\]",
BeautifulSoup(
requests.get(
"https://www.azlyrics.com/lyrics/a1/foreverinlove.html"
).content,
"html.parser"
)
.find("script")
.string,
re.S
).group(1)
)
)
print(json.dumps(data, indent=2)
輸出：
[
[
"genre",
"pop"
],
[
"artist",
"a1"
]
]
轉載請註明出處，本文鏈接：https://www.uj5u.com/shujuku/449240.html