使用Python爬取圖書館新書書名
2 min readMay 16, 2019
需在list.txt中存入網址
import requests
from bs4 import BeautifulSoupheaders = {'user-agent': 'Mozilla/5.0 (Windows NT 6.1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/52.0.2743.116 Safari/537.36'}
with open('list.txt') as url:
for urls in url:
resp = requests.get(urls, headers=headers)
resp.encoding = 'utf8'
soup = BeautifulSoup(resp.text, 'lxml')
bookName=soup.find_all(class_="briefcitTitle")
print(bookName)
目前爬取出來會出現html的標籤與書名，需自行將內容清理
爬取859本書費時110秒左右