python抓取数据例子

最新推荐文章于 2022-05-24 14:03:08 发布

追寻北极

最新推荐文章于 2022-05-24 14:03:08 发布

阅读量840

点赞数

分类专栏： python

本文链接：https://blog.csdn.net/joeyon1985/article/details/38922169

版权

python 专栏收录该内容

74 篇文章 0 订阅

订阅专栏

#coding=utf-8

#-*- coding: UTF-8 -*-  
import re
import urllib

def main():
    urls = ['http://www.forbeschina.com/review/201301/0022393.shtml',
    'http://www.forbeschina.com/review/201301/0022393_2.shtml',
    'http://www.forbeschina.com/review/201301/0022393_3.shtml',
    'http://www.forbeschina.com/review/201301/0022393_4.shtml',
    'http://www.forbeschina.com/review/201301/0022393_5.shtml',
    'http://www.forbeschina.com/review/201301/0022393_6.shtml']

    for url in urls:
        f = urllib.urlopen(url)
        html = f.read()
        content = re.compile(u'<div class="p_detail">.*?</div>', re.DOTALL) 
        style = content.search(html.decode('utf8'))
        if style:
            html = style.group(0)
            print 'Found it'
        else:
            print 'Not found.'
        para = re.sub('<[^>]*>', '', html);
        print para.encode('utf8') 


if __name__ == "__main__":
    main()