爬虫实例3:爬取微博热搜

1-获取微博热搜url

weibo_url = 'https://s.weibo.com/top/summary?cate=realtimehot'

2-创建存放微博热搜目录是否存在 不存在就创建

if not os.path.exists(r'd:/新浪新闻'):
    os.mkdir(r'd:/新浪新闻')

3-获取所需要的字段值

eles=selector.cssselect('tbody>tr')
ls=[]
for index, ele in enumerate(eles):
    title = ele.xpath('./td[@class="td-02"]/a/text()')[0]
    #print(title)
    url = ele.xpath('./td[@class="td-02"]/a/@href')[0]
    hot = ele.xpath('./td[@class="td-02"]/span/text()')
    #print(title,url,hot)
    cwawl_time =