今天抓取数据时使用re对数据进行提取时遇到的问题：syntaxError: Non-UTF-8 code starting with '\xe7',意思是有的中文字符无法转成utf-8的形式，如图所示：
这个是因为抓取的数据中有的中文字符识别不了，相应的数据如下：
"""
class="sale-num">0</span>件</div> </div> </dd>
</dl> <dl class="item " data-id="658360334789"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=658360334789" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=20-658360334789-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF
%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="//img.alicdn.com/bao/uploaded/i3/1672116384/O1CN01FXdpY61x1vFNFCEMr_!!0-item_pic.jpg_240x240.jpg" >
</a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=658360334789" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&sci
d=&lf_aclog=20-658360334789-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD
&tab=all&ss_bucket=18&
rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 秋季街头短款外套2021年新款女纯色百搭拉链连帽长袖卫衣直筒上衣</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">89.00</span></div>
<div class="sprice-area"><span class="symbol">¥</span><span class="s-price">158.00 </span></div> <!--rsdata.showSaleData: true-->
<div class="sale-area">已售：<span class="sale-num">1</span>件</div> </div> </dd> </dl> <dl class="item last" data-id="6585372
76231"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=658537276231" target="_blank" data-gold-url="/inshopse" data-gold-
data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=21-658537276231-24-null-1672116384&?src=shopsystem-
-33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&a
mp;shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="//img.alicdn.com/bao/uploaded/i4/1672116384/O1CN010VjOa51x1vFLT2NET_!!0-item_pic.jpg_240x240.jpg" > </a> </dt>
<dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=658537276231" target="_blank" data-gold-url="/inshopse" d
ata-gold-
data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=21-658537276231-24-null-1672116384&?src=shopsystem-
-33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 2022秋冬欧美街头短款修身棉服女立领拉链加厚外套保暖休闲棉衣</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">98.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">159.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sal
e-num">100+</span>件</div> </div> </dd> </dl> </div> <div class="item3line1"> <dl class="item " data-id="659042741963"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=659042741963" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=22-659042741963-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=
json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="//img.alicdn.com/bao/uploaded/i4/1672116384/O1CN01kJIsAT1x1vFLvhtUu_!!0-item_pic.jpg_240x240.jpg" > </a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=659042741963" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&
;scid=&lf_aclog=22-659042741963-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZ
f","bc_type":"c" }' > 2021冬新款镂空麻花条纹针织开衫女长袖连帽宽松拉链纯色休闲外套</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">99.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">175.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sale-num">0</span>件</div> </div> </dd> </dl> <dl class="item " data-id="659055837980"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=659055837980" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=23-659055837980-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="//img.alicdn.com/bao/uploaded/i3/1672116384/O1CN01KNlfAg1x1vFOCFwTe_!!0-item_pic.jpg_240x240.jpg" > </a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=659055837980" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=23-659055837980-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 2021欧美街头风高腰紧身纯色短款上衣女长袖圆领拉链开衫外套洋气</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">65.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">142.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sale-num">6</span>件</div> </div> </dd> </dl> <dl class="item last" data-id="659059105719"> <dt class="photo"> <a class="J_TGoldData" href="//item.taobao.com/item.htm?id=659059105719" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=24-659059105719-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > <img src="//img.alicdn.com/bao/uploaded/i1/1672116384/O1CN01YqbdA81x1vFJe0PMa_!!0-item_pic.jpg_240x240.jpg" > </a> </dt> <dd class="detail"> <a class="item-name J_TGoldData" href="//item.taobao.com/item.htm?id=659059105719" target="_blank" data-gold-url="/inshopse" data-gold-data='{"gokey":"at_bucketid=&srppage=1&scid=&lf_aclog=24-659059105719-24-null-1672116384&?src=shopsystem--33.7.235.200&sort=popular:des&q=%E5%A8%BC%EE%86%BD%E7%A5%A6%E6%BF%82%E5%AE%A0%EE%97%8A%E7%BC%87%E7%95%8C%E7%B2%A7%E9%8F%88%EF%BF%BD&tab=all&ss_bucket=18&rank_src=inshop_pc_tb&buyernick=tb089523630&shop_id=103889497&navigator=property&s=0&n=24&app=inshop&outfmt=json&stats_click=&rn=bf364af4330ca3ede3b1b5c333e63464", "cna": "BNQVHHXMNzMCATrRitnbrIZf","bc_type":"c" }' > 2022秋冬新款短款卫衣女欧美街头宽松套头运动健身半拉链翻领上衣</a> <div class="attribute"> <div class="cprice-area"><span class="symbol">¥</span><span class="c-price">69.00</span></div> <div class="sprice-area"><span class="symbol">¥</span><span class="s-price">155.00 </span></div> <!--rsdata.showSaleData: true--> <div class="sale-area">已售：<span class="sale-num">76</span>件</div> </div> </dd> </dl> </div> <div class="pagination"> <a class="disable">上一页</a> <a class="page-cur">1</a> <a class="J_SearchAsync" href="//shop103889497.taobao.com/search.htm?input_charset=gbk&mid=w-23677803207-0&wid=23677803207&path=%2Fsearch.htm&search=y&searcy_type=item&s_from=newHeader&ssid=s5-e&keyword=%E6%BD%AE%E6%B5%81%E5%A5%B3%E8%A3%85%E7%BE%BD%E7%BB%92%E6%9C%3F&pageNo=2#anchor">2</a> <a class="J_SearchAsync" href="//shop103889497.taobao.com/search.htm?input_charset=gbk&mid=w-23677803207-0&wid=23677803207&path=%2Fsearch.htm&search=y&searcy_type=item&s_from=newHeader&ssid=s5-e&keyword=%E6%BD%AE%E6%B5%81%E5%A5%B3%E8%A3%85%E7%BE%BD%E7%BB%92%E6%9C%3F&pageNo=3#anchor">3</a> <a class="J_SearchAsync next" href="//shop103889497.taobao.com/search.htm?input_charset=gbk&mid=w-23677803207-0&wid=23677803207&path=%2Fsearch.htm&search=y&searcy_type=item&s_from=newHeader&ssid=s5-e&keyword=%E6%BD%AE%E6%B5%81%E5%A5%B3%E8%A3%85%E7%BE%BD%E7%BB%92%E6%9C%3F&pageNo=2#anchor">下一页</a> <form action="//shop103889497.taobao.com/search.htm" method="get"> <input type="hidden" name="input_charset" value="gbk"> <input type="hidden" name="mid" value="w-23677803207-0"> <input type="hidden" name="wid" value="23677803207"> <input type="hidden" name="path" value="%2Fsearch.htm"> <input type="hidden" name="search" value="y"> <input type="hidden" name="searcy_type" value="item"> <input type="hidden" name="s_from" value="newHeader"> <input type="hidden" name="ssid" value="s5-e"> 到第 <input type="text" value="1" size="3" name="pageNo"> 页 <button type="submit">确定</button> </form> <!--END OF pagination--> </div> </div> </div>
"""解决方法：在脚本最上方添加
# coding=utf-8即可
扫一扫
1305
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
