Python爬虫urllib之模拟百度搜索

• 网页规律
  wd后面为你输入的字符串内容
  https://www.baidu.com/s?wd=

• 获取输入的搜索字符串内容

wd = input('输入搜索内容：')

• 将字符串URL编码

qs = {
        'wd': wd
    }
    qs = parse.urlencode(qs)

• 修改网页地址

url = 'http://www.baidu.com/s?'
fullurl = url + qs

• 整个代码为

from urllib import request, parse
if __name__ == '__main__':
    url = 'http://www.baidu.com/s?'
    wd = input('输入搜索内容：')
    qs = {
        'wd': wd
    }
    qs = parse.urlencode(qs)
    print(qs)

    fullurl = url + qs
    print(fullurl)

    rsp = requests.urlopen(fullurl)
    html = rsp.text
    rsp.encodng = 'utf-8'
    print(html)
    ```