1. 程式人生 > >求助微博爬蟲,python中BeautifulSoup之後的select()返回空字串

求助微博爬蟲,python中BeautifulSoup之後的select()返回空字串

from bs4 import BeautifulSoup
import requests
import re
headers = {
    'User-Agent':'Mozilla/5.0 (Windows NT 6.1; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/69.0.3497.100 Safari/537.36',
    'Cookie':'SINAGLOBAL=7454662639097.609.1536287628941; wvr=6; httpsupgrade_ab=SSL; wb_timefeed_5206743838=1; YF-Ugrow-G0=8751d9166f7676afdce9885c6d31cd61; login_sid_t=83d617be23e31f9ec3a186cf34c5d430; cross_origin_proto=SSL; YF-V5-G0=fec5de0eebb24ef556f426c61e53833b; _s_tentry=passport.weibo.com; wb_view_log=1920*10801.75; Apache=3897035978818.2905.1538967853231; ULV=1538967853236:20:3:2:3897035978818.2905.1538967853231:1538890580397; ALF=1570503871; SSOLoginState=1538967872; SCF=AsYXyKu7axto9XBpPVvlIzhqFEKDosWOQl01ZKf46saUdUBKm4XOtymcKtOM8L6DvcIQRtDX1ZWM-FRvtIvQpOM.; SUB=_2A252vrkQDeThGeNM61QW9C3EyDSIHXVVza3YrDV8PUNbmtBeLUatkW9NSZqkx0HZbo2PF7IQQbdSbBZwCGyBuY52; SUBP=0033WrSXqPxfM725Ws9jqgMF55529P9D9WhN2Qg1mTi5z6.QoObpcdRS5JpX5KzhUgL.Fo-EehqNSheRe0n2dJLoIpMLxK-LB.qL1KnLxKnLB--LBo50eon7Sntt; SUHB=0tK6n0c0dorpme; YF-Page-G0=1ac418838b431e81ff2d99457147068c; UOR=rs.xidian.edu.cn,widget.weibo.com,graph.qq.com; wb_view_log_5206743838=1920*10801.75'
}

href = 'https://d.weibo.com'
web_data = requests.get(href,headers = headers)
soup = BeautifulSoup(web_data.text,"lxml")
print(soup)

print(soup.select('WB_info'))

可以看到,列印soup可以返回資訊,資訊和微博利用F12的網頁資訊程式碼一樣。

我利用select選擇的話題,可是返回空字串,我一開始以為是  copy selector不對,可是後來怎麼除錯也不行。

求求哪位大神拉我一下,感激不盡