爬虫第六天，正则表达式

正则表达式

正则表达式是对字符串操作的一种逻辑公式

re.match

re.match吃食从字符串的起始位置匹配一个模式，如果不是起始位置匹配成功的话，match()就返回none

re.match(pattern,string,flags)

最常规的匹配

import re
content = 'Hello 123 4567 World_This is a Regex Demo'
result  = re.match('^Hello\s\d\d\d\s\d{4}\s\w{10}.*Demo$',content)
print(result)

泛匹配

import re 
content = 'Hello 123 4567 World_This is a Regex Demo'
result  = re.match('^Hello.*Demo$',content)
print(result)
print(result.group())
print(result.span())

匹配目标

import re 
content = 'Hello 1234567 World_This is a Regex Demo'
result  = re.match('^Hello\s(\d+)\sWorld.*Demo$',content)
print(result)
print(result.group(1))
print(result.span())

贪婪匹配

import re 
content = 'Hello 1234567 World_This is a Regex Demo'
result  = re.match('^He.*(\d+).*Demo$',content)
print(result)
print(result.group(1))
print(result.span())

非贪婪匹配

import re 
content = 'Hello 1234567 World_This is a Regex Demo'
result  = re.match('^He.*?(\d+).*Demo$',content)
print(result)
print(result.group(1))
print(result.span())

匹配模式

import re 
content = "Hello 1234567 World_This\
 is a Regex Demo\
"
result  = re.match('^He.*?(\d+).*Demo$',content,re.S)
print(result.group(1))

转义

import re 
content = 'price is $5.00'
result  = re.match('price is \$5\.00',content,re.S)
print(result)

尽量使用泛匹配、使用括号得到匹配目标、尽量使用贪婪模式、有换行符就用re.S

re.search

re.seach扫描整个字符串并返回第一个成功的匹配。

import re 
content = 'Extra string Hello 1234567 World_This is a Regex Demo Extra strings'
result  = re.search('Hello.*?(\d+).*?Demo',content,re.S)
print(result)
print(result.group(1))

总结：为匹配方便，能用search就不用match*

匹配演练

re.findall

搜索字符串，以列表形式返回全部能匹配的字符串

re.sub

替换字符串中每一个匹配的子串后返回替换后的字符串

html = re.sub('<a.*?>|</a>','',html)
print(html)
results = re.findall('<h3.*?>(.*?)</h3>',html,re.S)
print(results)
print(type(results))
for result in results:
    print(result.strip())

re.compile

将正则字符串编译成正则表达式