temp

最新推荐文章于 2021-08-09 19:03:47 发布

honyliu

最新推荐文章于 2021-08-09 19:03:47 发布

阅读量268

点赞数 1

分类专栏： temp

本文链接：https://blog.csdn.net/m0_37468234/article/details/58287388

版权

temp 专栏收录该内容

1 篇文章 0 订阅

订阅专栏

#coding=utf-8
import requests
from bs4 import BeautifulSoup
# res = requests.get('http://news.sina.com.cn/china/')
# res.encoding = 'utf-8'
#print type(res)
# print res.text

html_sample = '' \
              '<html>' \
              '<body>' \
              '<h1 id="title">Hello World </h1>' \
              '<a href="#" class="link">This is link1</a>' \
              '<a href="# link2" class="link">This is link2</a>' \
              '</body>' \
              '</html>'
soup = BeautifulSoup(html_sample,'html.parser')
#print type(soup)
print soup.text

小爬虫

#coding=utf-8
import requests
from bs4 import BeautifulSoup

res = requests.get('http://news.sina.com.cn/china/')
res.encoding = 'utf-8'
soup = BeautifulSoup(res.text,'html.parser')
# print res.text
for news in soup.select('.news-item'):
    newsh2 = news.select('h2')
    if len(newsh2) > 0:
        h2 = news.select('h2')[0].text
        a = news.select('a')[0]['href']
        time = news.select('.time')[0].text
        print time,h2,a