百度文库爬取分析

3个url 会返回页面的文字数据，

https://wkbjbos.bdimg.com/v1/docconvert814//wk/01ac47857af54eff3e3481af99446a6b/0.json?responseCacheControl=max-age%3D3888000&responseExpires=Thu%2C%2013%20Sep%202018%2010%3A38%3A19%20%2B0800&authorization=bce-auth-v1%2Ffa1126e91489401fa7cc85045ce7179e%2F2018-07-30T02%3A38%3A19Z%2F3600%2Fhost%2Fc9b4fcf4e4e77d1042543c6a83da1e74065600f7c255ecdce498186074542150&x-bce-range=0-14266&token=159ae1ea7d0b347cf13ec6fa241bce5e113afb1752c4c6dac71976c313bd2ed6&expire=2018-07-30T03:38:19Z

https://wkbjbos.bdimg.com/v1/docconvert814//wk/01ac47857af54eff3e3481af99446a6b/0.json?responseCacheControl=max-age%3D3888000&responseExpires=Thu%2C%2013%20Sep%202018%2011%3A03%3A57%20%2B0800&authorization=bce-auth-v1%2Ffa1126e91489401fa7cc85045ce7179e%2F2018-07-30T03%3A03%3A57Z%2F3600%2Fhost%2F30127d1b5507924ef3b040033705c159687e06d5c8322019625bb89383620696&x-bce-range=0-14266&token=31693fe9a9ec072fccc63da2db3258c52589d28e1039d41ab19730f39e75626a&expire=2018-07-30T04:03:57Z

 

 

0.json?responseCacheControl=max-age%3D3888000&responseExpires=Thu%2C%2013%20Sep%202018%2010%3A38%3A19%20%2B0800&authorization=bce-auth-v1%2Ffa1126e91489401fa7cc85045ce7179e%2F2018-07-30T02%3A38%3A19Z%2F3600%2Fhost%2Fc9b4fcf4e4e77d1042543c6a83da1e74065600f7c255ecdce498186074542150&x-bce-range=0-14266&token=159ae1ea7d0b347cf13ec6fa241bce5e113afb1752c4c6dac71976c313bd2ed6&expire=2018-07-30T03:38:19Z

 

可在网页源代码内找到，，get即可！

 

懒癌发作，，程序懒得写了，只写一点分析过程吧

转载于:https://www.cnblogs.com/martinho/p/9390155.html