Python爬虫学习

这次任务是



写一个程序，以一定时间频率刷新apple store，判断货物有/无状态； 当有货的时候，发一个短信给你手机。

1.首先在网站 http://store.apple.com/hk-zh/buy-iphone/iphone5s上找出所需要的内容。

2.编写相应的代码爬出所要内容。

url = 'http://store.apple.com/hk-zh/buy-iphone/iphone5s'
while 1:
    html = requests.get(url)
    reg = '{"dimensionColor":"(.*?)","dimensionCapacity":"(.*?)","partNumber":".*?","price":"(.*?)","displayShippingQuote":"(.*?)".*?}'
    r=re.compile(reg)
    mes = r.findall(html.text)
    for i in mes:
        print i[0]+'   ',i[1]+'   ','HK$'+i[2]+'   '+i[3]
        if i[3].encode('utf-8') == '有現貨':
              text = 'iphone5s有现货:'+'  颜色：'+i[0].encode('utf-8')+'  内存空间：'+i[1].encode('utf-8')+'  价格：HK$'+i[2].encode('utf-8')

 3.发送短信还不是很清楚，不过发送邮件的方法通过查询可以做到，相应代码如下：

import smtplib
import email
import mimetypes
from email.mime.multipart import MIMEMultipart
from email.mime.text import MIMEText
def sendmail(to_list,sub,con):
  """发送邮件
  """
# 设置服务器名称、用户名、密码以及邮件后缀s
  mail_host="smtp.163.com"
  mail_user="*****@163.com"
  mail_pass="*****"
  mail_postfix="mail.163.com"

  me = mail_user+"<"+mail_user+"@"+mail_postfix+">"
  msg = MIMEMultipart('related')
  msg['Subject'] = email.Header.Header(sub,'utf-8')
  msg['From'] = me
  msg['To'] = ";".join(to_list)
  msg.preamble = 'This is a multi-part message in MIME format.'

  msgAlternative = MIMEMultipart('alternative')
  msgText = MIMEText(con, 'plain', 'utf-8')
  msgAlternative.attach(msgText)
  msg.attach(msgAlternative)

  try:
    s = smtplib.SMTP()
    s.connect(mail_host)
    s.login(mail_user,mail_pass)
    s.sendmail(me, to_list, msg.as_string())
    s.close()

  except Exception,e:
    return False
  return True

4.通过将两个方法结合便可以初步完成目标。最后可以用time.sleep()方法来以一定频率刷新。