爬虫之旅，第一次尝试爬取整本小说

之前没有接触过爬虫，第一次接触感觉还是非常有意思的，首先做了一个非常小的爬虫来练手，随便爬了一本小说，将过程记录下来。

总结简单的爬虫分为以下几个步骤：

1.页面分析
对要爬取的页面进行分析，确定要爬取的信息，主要通过页面源代码和检查来看。
2.确定url
爬取的第一步肯定是要确定页面url，本次我要爬取的小说url为http://www.yuetut.com/cbook_24450
3.发起请求
python有很多第三方库，对于写惯c++的我来说，简直方便极了，要发起请求的话，首先要调用第三方库
import requests
然后发起请求
html =requests.get(r’http://www.yuetut.com/cbook_24450/’).content
4.筛选数据
筛选数据，要做的就是在网页源代码中找到自己要爬取的数据的标签位置。
像这里，我们要爬取的就是每一章节的目录链接

爬取结果如下：

`[<Element dl at 0x24e29fa9cc0>]
['/cbook_24450/305.html', '/cbook_24450/304.html', '/cbook_24450/303.html', '/cbook_24450/302.html', '/cbook_24450/301.html', '/cbook_24450/300.html', '/cbook_24450/299.html', '/cbook_24450/298.html', '/cbook_24450/1.html', '/cbook_24450/2.html', '/cbook_24450/3.html', '/cbook_24450/4.html', '/cbook_24450/5.html', '/cbook_24450/6.html', '/cbook_24450/7.html', '/cbook_24450/8.html', '/cbook_24450/9.html', '/cbook_24450/10.html', '/cbook_24450/11.html', '/cbook_24450/12.html', '/cbook_24450/13.html', '/cbook_24450/14.html', '/cbook_24450/15.html', '/cbook_24450/16.html', '/cbook_24450/17.html', '/cbook_24450/18.html', '/cbook_24450/19.html', '/cbook_24450/20.html', '/cbook_24450/21.html', '/cbook_24450/22.html', '/cbook_24450/23.html', '/cbook_24450/24.html', '/cbook_24450/25.html', '/cbook_24450/26.html', '/cbook_24450/27.html', '/cbook_24450/28.html', '/cbook_24450/29.html', '/cbook_24450/30.html', '/cbook_24450/31.html', '/cbook_24450/32.html', '/cbook_24450/33.html', '/cbook_24450/34.html', '/cbook_24450/35.html', '/cbook_24450/36.html', '/cbook_24450/37.html', '/cbook_24450/38.html', '/cbook_24450/39.html', '/cbook_24450/40.html', '/cbook_24450/41.html', '/cbook_24450/42.html', '/cbook_24450/43.html', '/cbook_24450/44.html', '/cbook_24450/45.html', '/cbook_24450/46.html', '/cbook_24450/47.html', '/cbook_24450/48.html', '/cbook_24450/49.html', '/cbook_24450/50.html', '/cbook_24450/51.html', '/cbook_24450/52.html', '/cbook_24450/53.html'