css选择器

最新推荐文章于 2023-01-29 18:49:46 发布

linuxvfast

最新推荐文章于 2023-01-29 18:49:46 发布

阅读量95

点赞数

分类专栏： python 日常记录文章标签： python 爬虫

本文链接：https://blog.csdn.net/linuxvfast/article/details/117196844

版权

日常记录同时被 2 个专栏收录

58 篇文章 0 订阅

订阅专栏

python

19 篇文章 0 订阅

订阅专栏

帮助文档
https://www.w3.org/TR/selectors-3/

原理：
css选择器的语法比xpath更简单一些，功能没有xpath强大。
当我们调用Selector对象的CSS方法时，在内部会使用python库的cssselect将css选择器的表达式翻译成xpath表达式，然后调用Selector对象的xpath方法。

基本语法
在这里插入图片描述

构建HtmlResponse对象

from scrapy.selector import Selector
from scrapy.http import HtmlResponse

body='''
<html>
	<head>
		<base href='http://example.com/'>
		<title>Example website</site>
	</head>
	<body>
		<div id='images-1' style="width:1230px;">
			<a href='image1.html'>Name:Image 1 <br/><img src='image1.jpg' /></a>
			<a href='image2.html'>Name:Image 2 <br/><img src='image2.jpg' /></a>
			<a href='image3.html'>Name:Image 3 <br/><img src='image3.jpg' /></a>
		</div>
		<div id="images-2" class="small">
			<a href='image4.html'>Name:Image 4 <br/><img src='image4.jpg' /></a>
			<a href='image5.html'>Name:Image 5 <br/><img src='image5.jpg' /></a>
		</div>
	</body>
</html>
'''

response = HtmlResponse(url='http://www.example.com',body=body,encoding='utf8')

选中所有的img

print(response.css('img'))
[<Selector xpath='descendant-or-self::img' data='<img src="image1.jpg">'>, 
<Selector xpath='descendant-or-self::img' data='<img src="image2.jpg">'>, 
<Selector xpath='descendant-or-self::img' data='<img src="image3.jpg">'>, 
<Selector xpath='descendant-or-self::img' data='<img src="image4.jpg">'>, 
<Selector xpath='descendant-or-self::img' data='<img src="image5.jpg">'>]

选中所有的base和title

print(response.css('base,title'))
[<Selector xpath='descendant-or-self::base | descendant-or-self::title' data='<base href="http://example.com/">'>, 
<Selector xpath='descendant-or-self::base | descendant-or-self::title' data='<title>Example website\n\t</title>'>]

选择div后代中的img

print(response.css('div img'))
[<Selector xpath='descendant-or-self::div/descendant-or-self::*/img' data='<img src="image1.jpg">'>, 
<Selector xpath='descendant-or-self::div/descendant-or-self::*/img' data='<img src="image2.jpg">'>, 
<Selector xpath='descendant-or-self::div/descendant-or-self::*/img' data='<img src="image3.jpg">'>, 
<Selector xpath='descendant-or-self::div/descendant-or-self::*/img' data='<img src="image4.jpg">'>, 
<Selector xpath='descendant-or-self::div/descendant-or-self::*/img' data='<img src="image5.jpg">'>]

选中body子元素中的div

print(response.css('body>div'))
[<Selector xpath='descendant-or-self::body/div' data='<div id="images-1" style="width:1230p...'>, 
<Selector xpath='descendant-or-self::body/div' data='<div id="images-2" class="small">\n\t\t\t...'>]

选中包含style属性的元素

print(response.css('[style]'))
[<Selector xpath='descendant-or-self::*[@style]' data='<div id="images-1" style="width:1230p...'>]

选中属性id值为images-1的元素

print(response.css('[id=images-1]'))
[<Selector xpath="descendant-or-self::*[@id = 'images-1']" data='<div id="images-1" style="width:1230p...'>]

选中每个div中的第一个a标签

print(response.css('div>a:nth-child(1)'))
[<Selector xpath='descendant-or-self::div/a[count(preceding-sibling::*) = 0]' data='<a href="image1.html">Name:Image 1 <b...'>, 
<Selector xpath='descendant-or-self::div/a[count(preceding-sibling::*) = 0]' data='<a href="image4.html">Name:Image 4 <b...'>]

选中第二个div中的第一个a标签

print(response.css('div:nth-child(2)>a:nth-child(1)'))
[<Selector xpath='descendant-or-self::div[count(preceding-sibling::*) = 1]/a[count(preceding-sibling::*) = 0]' data='<a href="image4.html">Name:Image 4 <b...'>]

选中第一个div中最后一个a标签

print(response.css('div:first-child>a:last-child'))
[<Selector xpath='descendant-or-self::div[count(preceding-sibling::*) = 0]/a[count(following-sibling::*) = 0]' data='<a href="image3.html">Name:Image 3 <b...'>]

选中所有a标签的文本

print(response.css('a::text').extract())
['Name:Image 1 ', 'Name:Image 2 ', 'Name:Image 3 ', 'Name:Image 4 ', 'Name:Image 5 ']

linuxvfast

关注

0
点赞
踩
0

收藏

觉得还不错? 一键收藏
0
评论
css选择器

帮助文档https://www.w3.org/TR/selectors-3/原理：css选择器的语法比xpath更简单一些，功能没有xpath强大。当我们调用Selector对象的CSS方法时，在内部会使用python库的cssselect将css选择器的表达式翻译成xpath表达式，然后调用Selector对象的xpath方法。基本语法构建HtmlResponse对象from scrapy.selector import Selectorfrom scrapy.http import H
复制链接

扫一扫